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(54) METHOD AND DEVICE FOR HUMAN DETECTION 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a human detecting 
method and its device which can discriminate mutually 
hidden or adjacent persons when detecting respective 
persons in a picked-up image and detect persons even if 
the direction and size of an object varies and even the same 
person have large shape variation in a moving picture. 
SOLUTION: Image feature output by an edge detection 
operator which has a gap expanded is made to correspond 
to a model shape set on the basis of the head of a person 
or the outline of the upper half part of the body which are 
hardly hidden and has small shape variation, and the 
maximum point of a product at each point is detected as a 
human area. Thus, the influence of a fine difference in 
outline shape is reduced and adjacent objects are separated 
and detected. This mentioned process is performed for an 
image obtained by photographing the space from above and 
persons in the obtained visual field are counted and 
totalized to actualize various information services such as 
analysis of a store customer distribution. 




m 



LEGAL STATUS 

[Date of request for examination] 14.1 1.2000 

[Date of sending the examiner s decision of 

rejection] 

[Kind of final disposal of application other than 
the examiner's decision of rejection or 
application converted registration] 
[Date of final disposal for application] 
[Patent number] 
[Date of registration] 

[Number of appeal against examiner's decision of 
rejection] 

[Date of requesting appeal against examiners 
decision of rejection] 

[Date of extinction of right] 



Copyright (C); 1998,2003 Japan Patent Office 



* NOTICES * 



Japan Patent: Office is not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 

[Claim(s)] 

[Claim 1] In a person detection method of performing person detection processing in which photo a 
field where many persons exist or move, acquire an image, and a person's image is extracted from 
an acquired image To a relative position corresponding to a location of two or more points of having 
been beforehand set up on a person geometric model of a configuration based on a person outline 
Arrange a characteristic quantity detector which detects characteristic quantity of a person who is 
going to detect, and a characteristic quantity detector set is constituted. A characteristic quantity 
detector set is put on each location corresponding to each coordinate set as an image side. Image 
characteristic quantity detected based on a value of image characteristic quantity which detected 
image characteristic quantity of said acquired image, and a characteristic quantity detector which 
constitutes a characteristic quantity detector set in said each location detected is in predetermined 
tolerance. A predetermined operation for judging that it is the characteristic quantity of an image 
which has a configuration corresponding to said person geometric model is performed. A person 
detection method presumed that a portrait image exists in the location concerned when it is shown 
that it is the characteristic quantity of an image with which the result of an operation has a 
configuration with which said detected image characteristic quantity agrees in said person 
geometric model. 

[Claim 2] Said predetermined operation is the person detection method according to claim 1 which 
calculates a product of characteristic quantity which each characteristic quantity detector detected 
in each location of a characteristic quantity detector set, and includes processing which judges the 
product to be a portrait image [ in / for the image concerned / the location concerned ] when a 
value of the product exceeds the predetermined threshold concerned as compared with a 
predetermined threshold. 

[Claim 3] Match said predetermined operation with a coordinate of an image side corresponding to a 
location of the characteristic quantity detector set concerned by making into an evaluation value a 
product of characteristic quantity which each characteristic quantity detector detected, and it 
generates an evaluation value image. Set up a partial field centering on each pixel in an evaluation 
value image, and it searches for the maximum point that an evaluation value becomes the maximum 
in a partial field. A method including processing which makes a pixel which exists at the center of a 
partial field that the maximum point that an evaluation value exceeds a predetermined threshold 
among the maximum point exists a point that a person exists according to claim 2. 
[Claim 4] Each characteristic quantity detector arranged in a relative position corresponding to a 
location of two or more points of having been beforehand set up on a person geometric model It is 
defined as a characteristic quantity detector corresponding to a point of having been beforehand set 
up on the person geometric model concerned. A displacement vector from a location of two or more 
of said points on said person geometric model set up beforehand to an origin/datum set as a person 
geometric model at arbitration It is defined as a vector, characteristic quantity of a characteristic 
quantity detector corresponding to two or more points concerned — displacement — When 
characteristic quantity which each characteristic quantity detector detected is matched with a 
coordinate of a location which displaced only a characteristic quantity displacement vector and is 
defined as displacement characteristic quantity in the coordinate concerned corresponding to the 
characteristic quantity detector concerned from a location where the characteristic quantity was 



detected, An operation of a product of characteristic quantity which said each characteristic 
quantity detector detected is a method including processing which calculates a product of 
displacement characteristic quantity corresponding to each characteristic quantity detector about 
each coordinate of an image side according to claim 2. 

[Claim 5] An image acquisition means to incorporate an image frame which is characterized by 
providing the following and which was photoed with a camera which photos a field where many 
persons exist or move, and to create an image in which an image processing is possible, Hold a 
person geometric model, extract an image which has a configuration corresponding to a person 
geometric model from an image in which said image processing is possible, and each extracted 
image as a person currently picturized all over an image side Person detection equipment which has 
a person detection means to output a coordinate on an image plane of a point of representing a 
location where an extracted everybody object exists Said person detection means is equipped with 
a characteristic quantity detector set which becomes with 1 set of characteristic quantity 
detectors arranged in a relative position corresponding to a location of two or more points of having 
been beforehand set up on a person geometric model. With said characteristic quantity detector set 
The characteristic quantity calculation section which detects image characteristic quantity, and 
detected image characteristic quantity is made to correspond with a coordinate of an image side, 
and outputs it about each point of an image side acquired by image acquisition means in a relative 
position corresponding to each location on a person geometric model A predetermined operation is 
performed to a value of an image characteristic quantity set with which each characteristic quantity 
detector of a characteristic quantity detector set becomes with 1 set of image characteristic 
quantity detected in said relative position. Evaluation value operation part which evaluates a degree 
to which an image characteristic quantity set has agreed with a person geometric model proper, 
generates an evaluation value corresponding to a location on an image side of a characteristic 
quantity detector set, and generates an evaluation value image showing an evaluation value 
corresponding to each coordinate of an image side The maximum point retrieval section which 
searches for the evaluation value maximum point that an evaluation value corresponding to a 
coordinate of the pixel concerned serves as max in a nearby field about a pixel of each coordinate 
of an image side, and outputs a coordinate of the acquired evaluation value maximum point as a 
point that a person exists, to an evaluation value image computed by evaluation value operation part 

[Claim 6] The characteristic quantity calculation section is equipped with an operator set which 
becomes by 1 set of edge detection operators as a characteristic quantity detector set. With said 
operator set In a relative position corresponding to two or more locations which can be set on an 
outline of a person geometric model An image outline is detected about each point of an image side 
acquired by image acquisition means. From a location of two or more points of having made a 
detection value of a detected image outline corresponding with a coordinate of an image side, having 
outputted it, and having been beforehand set up on said person geometric model It is defined as a 
vector, displacement to an origin/datum set as a person geometric model at arbitration — 
characteristic quantity of an edge detection operator who is in a relative position corresponding to a 
location of two or more points concerned about a vector — displacement — An edge detection 
value which each edge detection operator detected is matched with a coordinate of a location which 
displaced only a characteristic quantity displacement vector from a location where the edge 
detection value was detected. When defining it as displacement characteristic quantity in the 
coordinate concerned corresponding to the edge detection operator concerned, evaluation value 
operation part As a predetermined operation to a value of said image characteristic quantity set, 
about each coordinate of an image side A product of displacement characteristic quantity about an 
edge detection value which each edge detection operator detected is calculated. The maximum 
point retrieval section A partial field centering on each pixel in an evaluation value image obtained 
by evaluation value operation part is set up. Equipment according to claim 5 which searches for the 
maximum point that an evaluation value serves as the maximum, in a partial field, and outputs a 
location of a pixel which exists at the center of a partial field that the maximum point that an 
evaluation value exceeds a predetermined threshold exists as a location of a point that a person 
exists. 



[Claim 7] Evaluation value operation part has an edge detection operator with small detection edge 
width of face, and an edge detection operator with large detection edge width of face as a 
characteristic quantity detector. Each edge detection operator He is the gap escape operator who 
extended field width of face of the central gap section which does not have weight in a degree which 
outputs a detection value stabilized even if a configuration of a portrait image had a very small 
change. An edge detection operator Equipment according to claim 6 with which configuration change 
is arranged in a relative position corresponding to few persons' part that it is hard to generate 
concealment. 

[Claim 8] Equipment according to claim 5 characterized by providing the following a person who 
does counting of the person who exists in a field currently photoed based on a detection result 
obtained by person detection means — counting — a means — having — said person — counting - 
- a means A look-up table which indicated a value of a parameter required in order to presume a 
location in a person's real space, or a pixel and a person's spatial position is memorized. The storage 
section corresponding to an image and a location which performs a calibration by initial setting in 
advance, takes correspondence with each pixel in an image, and a spatial position before measuring, 
and memorizes this correspondence beforehand A person location detecting element which 
considers that a point that a person whom a person detection means outputs exists is the location 
of the head of a portrait image in an image, and presumes a location in a person's space based on 
information on storage 42 corresponding to an image and a location The person densitometry 
section which measures the number in a very small field and computes person density based on a 
person location detected by person location detecting element 

[Claim 9] A calibration is equipment including the processing which calculates two angles which 
describe with five equations by making into a parameter two angles which express a global 
coordinate of a camera, and a posture of a camera for relation with a location on an image plane of 
an object point location arranged to five predetermined spatial positions, and the image point which 
picturizes this object point and is obtained, and express a global coordinate of probable camera, and 
a posture of a camera with the least square method according to claim 8. 

[Claim 10] a person — counting — counting which relates person density by which counting was 
carried out with a means with time of day which picturized an image, and records it serially — 
equipment according to claim 8 which has a result storage means. 

[Claim 11] Equipment according to claim 8 characterized by providing the following a person — 
counting — counting obtained by means — a result or said counting — counting of the time of day 
of the past accumulated in a result storage means — counting which displays by processing a result 
if needed — a result display means having — said counting — the number storage section of 
purchase visitors which memorizes the number of purchase visitors per unit time amount over all 
business hours based on data which recorded a result display means counting — a rate display of 
purchase which totals a rate of purchase, i.e., the number of purchase visitors / the number of 
coming-toH:he-store visitors, according to predetermined conditions based on the number of 
purchase visitors memorized by the number of coming-toH:he-store visitors per [ which was 
memorized by result storage ] unit time amount, and said number storage section of purchase 
visitors 

[Claim 12] Equipment according to claim 8 characterized by providing the following a person — 
counting — counting obtained by means — a result or said counting — counting of time of day of 
the past accumulated in a result storage means — counting which displays by processing a result if 
needed — a result display means having — said counting — the number storage section of 
employees which memorizes the number of employees to which a result display means is working at 
each time of day counting — the average reception numeral section which totals and displays the 
number of reception per employee, i.e., the number of coming-to-the-store visitors / the number of 
employees, according to predetermined conditions based on the number of employees memorized by 
the number of coming-to-the-store visitors per unit time amount and the number storage section of 
employees which were memorized by result storage means 

[Claim 13] a person — counting — counting obtained by means — a result or said counting — 
counting of time of day of the past accumulated in a result storage means — a result counting 
which displays by processing it if needed — a result display means having — said counting — a 



result display means The number storage section of the registers used which memorizes the number 
of registers currently used for each time of day is compared with the number of registers memorized 
by the number of optimal registers and the number storage of the registers used which are 
presumed from the customer number on a par with a register. Equipment according to claim 8 which 
has the number KONSARUTO section of registers which totals and indicates whether the number of 
registers currently used for every time of day has exceeded a required number, or be less according 
to predetermined conditions. 

[Claim 14] a person — counting — counting obtained by means — a result or said counting — 
counting of time of day of the past accumulated in a result storage means — a result counting 
which displays by processing it if needed — a result display means having — said counting — a 
result display means The employee storage section in a counter which memorizes the number of 
employees arranged at each time of day at the above-mentioned counter, The number of employees 
memorized by the number of optimal employees presumed from the customer number in a specific 
counter and the number storage of employees is compared. Equipment according to claim 8 which 
has the number KONSARUTO s ection of the employees in a counter which totals and indicates 
whether the royees arranged for every time of day has exceeded a required number, 

or be less according to predetermined conditions. 

[Claim 15] a person — counting — counting obtained by means — a result or said counting — 
counting of time of day of the past accumulated in a result storage means — a result counting 
which displays by processing it if needed — a result display means having — - said counting — a 
result display means A customer to whom each lift or an attraction facility is located in a line with 
the unit time amount processing number storage section which memorizes the number sold to per 
unit time amount, a lift, or an attraction facility, From the number sold to per unit time amount, each 
lift or an attraction facility memorized by the number and the unit time amount processing number 
storage section which were recorded Equipment according to claim 8 with which a customer has a 
latency-time display which displays the latency time which computed the number which a facility 
sells to the latency time over service of the facility concerned, i.e., a customer's number / unit time- 
amount located in a line, and was computed to a bulletin board formed in an every place point of 
play-facilities inside and outside in image pick-up time of day. 

[Claim 16] Image acquisition processing which incorporates an image frame photoed with a camera 
which photos a field where many persons exist or move, and creates an image in which an image 
processing is possible A configuration which holds a person geometric model and agrees in a person 
geometric model from an. image in which said image processing is possible It is the record medium 
with which a person detection program equipped with the above is recorded. Image characteristic 
quantity is detected about each point of an image side acquired by image acquisition processing. 
Characteristic quantity calculation processing which detected image characteristic quantity is made 
to correspond with a coordinate of an image side, and outputs it is performed. A predetermined 
operation is performed to a value of an image characteristic quantity set with which each 
characteristic quantity detector of a characteristic quantity detector set becomes with 1 set of 
image characteristic quantity detected in said relative position. A degree to which an image 
characteristic quantity set has agreed with a person geometric model proper is evaluated. An 
evaluation value is generated corresponding to a location on an image side of a characteristic 
quantity detector set. Evaluation value data processing which generates an evaluation value image 
showing an evaluation value corresponding to each coordinate of an image side is performed. As .. 
opposed to an evaluation value image computed by evaluation value data processing about a pixel of 
each coordinate of an image side It is characterized by describing a procedure for performing the 
maximum point retrieval processing which searches for the evaluation value maximum point that an 
evaluation value corresponding to a coordinate of the pixel concerned serves as max in a nearby 
field, and outputs a coordinate of the acquired evaluation value maximum point as a point that a 
person exists. 
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DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] This invention relates to the image-processing 
method and equipment which detect an everybody object and perform counting and a congestion 
factor display about the image-processing method and equipment which detect the person in an 
image from the image with which the person of a large number obtained especially [ in a store or a 
public facility etc. ] was picturized. 
[0002] 

[Description of the Prior Art] the case where a person field is detected from the image with which 
two or more persons were picturized — the former — a background — difference and inter-frame - 
- various approaches, such as a pattern exposure of difference, edge detection, optical flow 
calculation, infrared spot light, etc. and use of the depth map by the stereo method, are taken. Or 
the technique of having used together the energy model which used an edge like Snake for 
characteristic quantity, use of beige detection color matching information or the image analysis 
between space-time, etc. is also studied. .. . _ 

[0003] moreover, the equipment which detects the person picturized by the photographic film to 
JP,9-281605,A using beige detection processing, and determines the number of extra copy sheets 
as it automatically according to the number of persons which carried out counting as an example 
which carries out counting of two or more person object in an image using such technology is 
indicated, moreover, counting [ JP,8-123935,A ] of the plurality [ inside / of an image ] as another 
example — Rhine — preparing — a background — by connecting the image obtained by performing 
difference in the direction of time amount, the image between space-time is created and the 
method of judging the passage direction from the animal object field in the image between space- 
time is indicated. 

[0004] furthermore — as the example which measures a person's density — JP,1 -244598, A — a 
background — when difference extracts a person image and the bias of unnatural distribution and 
the condition of unwilling density are extracted, the technique of emitting an alarm is indicated. 
[0005] 

[Problem(s) to be Solved by the Invention] However, by the technique shown above, concealment 
between the fields generated among two or more persons cannot be coped with, but since it is 
difficult to distinguish and detect the person picturized adjacently, the application to the image with 
which many persons were picturized has the problem of being difficult. 

[0006] for example, a background — in the case of difference, since two or more persons who 
overlap in an image are started as one field, an everybody object is undetectable according to an 
individual. In being the system by which counting is called for, it performs processing which 
presumes the near number by usually breaking the area of the extracted field by per capita area. 
However, in the conventional background finite difference method, the area which overlaps both the 
persons in an image, the magnitude of an everybody object, etc. were difficult for counting with it. 
[ a large fluctuation factor and ] [ exact ] 

[0007] Moreover, under the circumstances which picturize many persons, the sense to the target 
camera, and a posture and magnitude were various, and since the configuration change in a dynamic 
image was large even if it was the same person, application of a geometric model was also difficult. 



[0008] Person detection and counting in the image with which, as for the purpose of this invention, 
many persons were picturized, Congestion factor measurement can be performed also in the 
condition that the difference in the configuration for every each set elephant or magnitude or 
concealment between objects exists, and the small art and the equipment of constraint of image 
pick-up conditions — providing — further — this art and equipment — using — continuous — a 
person — it is realizing the equipment which performs counting and congestion factor measurement 
and provides origin with various data utility for the obtained accumulation result. 
[0009] 

[Means for Solving the Problem] In order to solve the above-mentioned technical problem, a person 
detection method of this invention To a relative position corresponding to a location of two or more 
points of having been beforehand set up on a person geometric model of a configuration based on a 
person outline Arrange a characteristic quantity detector which detects characteristic quantity of a 
person who is going to detect, and a characteristic quantity detector set is constituted. A 
characteristic quantity detector set is put on each location corresponding to each coordinate set as 
an image side. Image characteristic quantity detected based on a value of image characteristic 
quantity which detected image characteristic quantity of said acquired image, and a characteristic 
quantity detector which constitutes a characteristic quantity detector set in said each location 
detected is in predetermined tolerance. A predetermined operation forjudging that it is the 
characteristic quantity of an image which has a configuration corresponding to said person 
geometric model is performed. When it is shown that it is the characteristic quantity of an image 
with which the result of an operation has a configuration with which said detected image 
characteristic quantity agrees in said person geometric model, it is presumed that a portrait image 
exists in the location concerned. 

[0010] In each location of a characteristic quantity detector set, the aforementioned predetermined 
operation calculates a product of characteristic quantity which each characteristic quantity 
detector detected, and includes processing which judges the product to be a portrait image [ in / 
for the image concerned / the location concerned ] when a value of the product exceeds the 
predetermined threshold concerned as compared with a predetermined threshold. 
[0011] As one embodiment of the aforementioned predetermined operation, this predetermined 
operation Match with a coordinate of an image side corresponding to a location of the characteristic 
quantity detector set concerned by making into an evaluation value a product of characteristic 
quantity which each characteristic quantity detector detected, and an evaluation value image is 
generated. A partial field centering on each pixel in an evaluation value image is set up, it searches 
for the maximum point that an evaluation value becomes the maximum in a partial field, and 
processing which makes a pixel which exists at the center of a partial field that the maximum point 
that an evaluation value exceeds a predetermined threshold among the maximum point exists a 
point that a person exists is included. 

[0012] An operation of a product of characteristic quantity which said each characteristic quantity 
detector detected is performed by performing processing which calculates a product of 
displacement characteristic quantity corresponding to each characteristic quantity detector about 
each coordinate of an image side. However, each characteristic quantity detector arranged in a 
relative position corresponding to a location of two or more points of having been beforehand set up 
on a person geometric model It is defined as a characteristic quantity detector corresponding to a 
point of having been beforehand set up on the person geometric model concerned. A displacement 
vector from a location of two or more of said points on said person geometric model set up 
beforehand to an origin/datum set as a person geometric model at arbitration It is defined as a 
vector, characteristic quantity of a characteristic quantity detector corresponding to two or more 
points concerned — displacement — From a location where the characteristic quantity was 
detected, characteristic quantity which each characteristic quantity detector detected is matched 
with a coordinate of a location which displaced only a characteristic quantity displacement vector, 
and is defined as displacement characteristic quantity in the coordinate concerned corresponding to 
the characteristic quantity detector concerned. 

[0013] Image acquisition equipment which person detection equipment of this invention incorporates 
an image frame photoed with a camera which photos a field where many persons exist or move, and 



creates an image in which an image processing is possible, Hold a person geometric model, extract 
an image which has a configuration corresponding to a person geometric model from an image in 
which said image processing is possible, and each extracted image as a person currently picturized 
all over an image side It has person detection equipment which outputs a coordinate on an image 
plane of a point of representing a location where an extracted everybody object exists. 
[0014] Person detection equipment is equipped with a characteristic quantity detector set which 
becomes with 1 set of characteristic quantity detectors arranged in a relative position 
corresponding to a location of two or more points of having been beforehand set up on a person 
geometric model. With said characteristic quantity detector set In a relative position corresponding 
to each location on a person geometric model The characteristic quantity calculation section which 
detects image characteristic quantity, and detected image characteristic quantity is made to 
correspond with a coordinate of an image side, and outputs it about each point of an image side 
acquired by image acquisition equipment, A predetermined operation is performed to a value of an 
image characteristic quantity set with which each characteristic quantity detector of a 
characteristic quantity detector set becomes with 1 set of image characteristic quantity detected in 
said relative position. A degree to which an image characteristic quantity set has agreed with a 
person geometric model proper is evaluated. Evaluation value operation part which generates an 
evaluation value corresponding to a location on an image side of a characteristic quantity detector 
set, and generates an evaluation value image showing an evaluation value corresponding to each 
coordinate of an image side, As opposed to an evaluation value image computed by evaluation value 
operation part about a pixel of each coordinate of an image side It has the maximum point retrieval 
section which searches for the evaluation value maximum point that an evaluation value 
corresponding to a coordinate of the pixel concerned serves as max in a nearby field, and outputs a 
coordinate of the acquired evaluation value maximum point as a point that a person exists. 
[0015] The characteristic quantity calculation section is equipped with an operator set which 
becomes by 1 set of edge detection operators as a characteristic quantity detector set. With this 
operator set In a relative position corresponding to two or more locations which can be set on an 
outline of a person geometric model An image outline is detected about each point of an image side 
acquired by image acquisition means, and a detection value of a detected image outline is made to 
correspond with a coordinate of an image side, and is outputted. Evaluation value operation part As 
a predetermined operation to a value of said image characteristic quantity set, about each 
coordinate of an image side A product of displacement characteristic quantity about an edge 
detection value which each edge detection operator detected is calculated. The maximum point 
retrieval section A partial field centering on each pixel in an evaluation value image obtained by 
evaluation value operation part is set up, it searches for the maximum point that an evaluation value 
serves as the maximum in a partial field, and a location of a pixel which exists at the center of a 
partial field that the maximum point that an evaluation value exceeds a predetermined threshold 
exists is outputted as a location of a point that a person exists. 

[0016] About a function of the aforementioned evaluation value operation part, from a location of 
two or more points of having been beforehand set up on a person geometric model It is defined as a 
vector, displacement to an origin/datum set as a person geometric model at arbitration — 
characteristic quantity of an edge detection operator who is in a relative position corresponding to a 
location of two or more points concerned about a vector — displacement — From a location where 
the edge detection value was detected, an edge detection value which each edge detection operator 
detected is matched with a coordinate of a location which displaced only a characteristic quantity 
displacement vector, and is defined as displacement characteristic quantity in the coordinate 
concerned corresponding to the edge detection operator concerned. 

[0017] Evaluation value operation part has an edge detection operator with small detection edge 
width of face, and an edge detection operator with large detection edge width of face as a 
characteristic quantity detector. Each edge detection operator It is the gap escape operator who 
extended field width of face of the central gap section which does not have weight in a degree which 
outputs a detection value stabilized even if a configuration of a portrait image had a very small 
change, and an edge detection operator is stationed in a relative position corresponding to a part of 
a person with little configuration change that it is hard to generate concealment. 



[0018] Person detection equipment of this invention has a person counter which carries out 
counting of the person who exists in a field currently further photoed based on a detection result 
obtained by person detection equipment. A value of a parameter required in order that a person 
counter may presume a location in a person's real space, Or a look-up table which indicated a pixel 
and a person's spatial position is memorized. The storage section corresponding to an image and a 
location which performs a calibration by initial setting in advance, takes correspondence with each 
pixel in an image, and a spatial position before measuring, and memorizes this correspondence 
beforehand, A person location detecting element which considers that a point that a person whom a 
person detection means outputs exists is the location of the head of a portrait image in an image, 
and presumes a location in a person's space based on information on the storage 42 corresponding 
to an image and a location, Based on a person location detected by person location detecting 
element, the number in a very small field is measured and it has the person densitometry section 
which computes person density. 

[0019] An object point location arranged to five predetermined spatial positions as one of the 
aforementioned calibrations, Relation with a location on an image plane with the image point which 
picturizes this object point and is obtained Five equations describe by making two angles (an 
elevation angle and azimuth) showing a global coordinate of a camera location, and a posture of a 
camera into a parameter, and it is carried out by calculating two angles which express a global 
coordinate of probable camera location, and a posture of a camera with the least square method. 
[0020] counting which person detection equipment of this invention relates person density by which 
counting was carried out with a person counter with time of day which picturized an image, and is 
recorded serially — it can have result storage. 

[0021] counting from which person detection equipment of this invention was obtained by person 
counter — a result or counting — : counting of time of day of the past stored in result storage — a 
result counting which displays by processing it if needed — result display having — counting — a 
result display The number storage section of purchase visitors which memorizes the number of 
purchase visitors-per unit time amount over all business hours based on recorded data, counting — 
based on the number of purchase visitors memorized by the number of coming-to-the-store visitors 
per [ which was memorized by result storage ] unit time amount, and said number storage section of 
purchase visitors, it can have a rate display of purchase which totals a rate of purchase, i.e., the 
number of purchase visitors / the number of coming-to-the-store visitors, according to 
predetermined conditions, counting of this invention — as other embodiments of a result display — 
counting — a result display It is based on the number of employees memorized by the number of 
coming-to-the-store visitors per unit time amount and the number storage section of employees 
which were memorized by result storage means, the number storage section of employees which 
memorizes the number of employees which is working at each time of day, and counting — It can 
have the average reception numeral section which totals and displays the number of reception per 
employee, i.e., the number of coming-to-the-store visitors / the number of employees, according to 
predetermined conditions. 

[0022] counting of this invention — as other embodiments of a result display — counting — a 
result display The number storage section of the registers used which memorizes the number of 
registers currently used for each time of day is compared with the number of registers memorized 
by the number of optimal registers and the number storage of the registers used which are 
presumed from the customer number on a par with a register. It can have the number KONSARUTO 
section of registers which totals and indicates whether the number of registers currently used for*- 0 * 
every time of day has exceeded a required number, or be less according to predetermined 
conditions. 

[0023] counting of this invention — as other embodiments of a result display — counting — a 
result display The employee storage section in a counter which memorizes the number of employees 
arranged at each time of day at the above-mentioned counter, The number of employees memorized 
by the number of optimal employees presumed from the customer number in a specific counter and 
the number storage of employees is compared. It can have the number KONSARUTO section of the 
employees in a counter which totals and indicates whether the number of employees arranged for 
every time of day has exceeded a required number, or be less according to predetermined 



conditions. 

[0024] counting of this invention — as the embodiment of further others of a result display — 
counting — a result display A customer to whom each lift or an attraction facility is located in a line 
with the unit time amount processing number storage section which memorizes the number sold to 
per unit time amount, a lift, or an attraction facility, From the number sold to per unit time amount, 
each lift or an attraction facility memorized by the number and the unit time amount processing 
number storage section which were recorded In image pick-up time of day, a customer can compute 
the latency time (number which a facility sells to the number / unit time amount of a customer who 
has stood in a line) over service of the facility concerned, and can have a latency-i:ime display 
which displays the latency time computed to a bulletin board formed in an every place point of play- 
facilities inside and outside. 
[0025] 

[Function] Although the characteristic quantity detector which constitutes a characteristic quantity 
detector set generates a characteristic quantity image, respectively," each characteristic quantity 
detector generates a characteristic quantity image in the location where only the relative position of 
these characteristic quantity detector shifted, therefore, the image side corresponding to [ when 
each characteristic quantity detector generates a characteristic quantity image to a separate image 
side ] each characteristic quantity detector — the relative displacement and hard flow of a 
characteristic quantity detector — a parallel displacement — carrying out — piling up (it 
compounding) — the same portion of the characteristic quantity image of each image side laps. 
However, even if it carries out above-mentioned parallel displacement and synthetic processing, the 
portion (it is hereafter described as a different characteristic quantity image portion) from which the 
characteristic quantity image with which each image sides differ, or the same characteristic quantity 
image differs will not lap, if those characteristic quantity image portions are not in a special relative 
position with which it laps by the parallel displacement and synthetic processing. If it puts in 
another way, a characteristic quantity image portion with the same relative configuration as the 
relative configuration of a characteristic quantity detector, i.e., the characteristic quantity image 
corresponding to a person geometric model, will lap with coincidence by the parallel displacement 
and synthetic processing. This invention extracts only the characteristic quantity image of a portrait 
image from a characteristic quantity image side by this principle. 

[0026] In this case, the person geometric model to be used is carried out based on the outline edge 
information on the head of the small person of configuration change, and the upper half of the body 
that it is comparatively hard to generate concealment, and is set up in the average magnitude of the 
person in an image. Moreover, since a large-sized gap escape mold edge detection operator is made 
for a small gap escape mold edge detection operator to correspond to an upper-half-o^-the-body 
outline with a large configuration as a characteristic quantity detector in the head where a 
configuration is small, the person of various configurations is certainly detectable. 
[0027] By processing using the above means, it is possible to detect two or more person locations 
which exist in the field of view of a camera, and to perform counting. Moreover, since there is little 
constraint to photography conditions, such as migration of a camera and lighting, the flexible system 
configuration using an existing surveillance camera and an existing portable camera is possible, and 
various technical expansions are possible. 
[0028] 

[Embodiment of the Invention] Next, the gestalt of operation of this invention is explained to details 
with reference to a drawing. Drawing 1. is the whole block diagram showing the configuration of the 
person detection equipment for enforcing the person detection method of this invention, the person 
detection equipment of this invention — fundamental — a camera 1, image acquisition equipment 2, 
person detection equipment 3, the person counter 4, and counting — the result storage 5 and 
counting — it has the result display 6. 

[0029] A camera 1 is installed above the object space where many persons exist, and photos the 
image which changes a single camera or two or more cameras, and contains a person group. The 
image frame photoed with the camera 1 is changed if needed, and it incorporates with a 
predetermined time interval, and discretization etc. processes common knowledge and, as for image 
acquisition equipment 2, obtains the static image in which an image processing is possible. 



[0030] Person detection equipment 3 outputs the coordinate of the point (it describes as a 
representation point hereafter) of representing the field where the person concerned exists as a 
person who holds a person's outline geometric model, extracts the image which has the 
configuration which is in predetermined tolerance and agrees in this outline geometric model from 
the image captured by image acquisition equipment 2, and is picturized in the image in each 
extracted image on an image plane. 

[0031] The person counter 4 carries out counting of the number of persons which exists in the field 
of view in an image from the person detection result obtained by person detection equipment 3. 
counting — the number of persons by which counting was carried out with the person counter 4 is 
related with the time of day which picturized the image, and the result storage 5 records it serially, 
counting — the person in the image to which counting of the result display 6 was carried out with 
the person counter 4 - — counting — a result or said counting — the person in the time of day of 
the past accumulated in the result storage 5 — counting — it displays by processing a result if 
needed. 

[0032] Next, actuation of this operation gestalt is explained. Drawing 2 is a flow chart which shows 
the manipulation routine in this operation gestalt. The image frame containing the person group of a 
large number in the object space photoed with the camera 1 is changed if needed by image 
acquisition equipment 2, is dispersed with a predetermined time interval, and is incorporated in 
equipment as a static image which can be processed (step A1). Person detection equipment 3 
performs processing which detects the everybody object contained in an image to this image (step 
A2). Counting of the coordinate train which shows the person field obtained by person detection 
equipment 3 by processing of step A2 is carried out by the person counter 4 (step A3), counting — 
as the number of presumed persons with which the result is picturized by the image — counting — 
in the result storage 5, it is related with the time of day when the image was picturized, and 
memorizes — having (step A4) — counting — it is outputted to the result display 6. 
[0033] the person by whom counting was done with the person counter 4 — counting — a result 
and counting — the person in the time-of day of the past accumulated in the result storage 5 — 
counting — a result — counting — counting [ on the result display 6 and as opposed to / 
corresponding to necessity / corresponding to a demand of an operator / time amount ] — it is 
displayed after various processings, such as a superposition display in a result graph or an 
acquisition image, are performed (step A5, A6). 

[0034] Processing is ended, when there will not be a repeat (Y of branching A7) and an image input 
about processing similarly to the image which returns to step A1 and then is obtained if the input 
image is given further after the above processing is completed (N of branching A7). 
[0035] Next, 1 operation gestalt of the person detecting element 3 of drawing 1 is explained. 
Drawing 3 is the block diagram showing the configuration of one example of the person detecting 
element 3. The person detection equipment of this example is equipped with the characteristic 
quantity calculation section 301, the evaluation value operation part 302, and the maximum point 
retrieval section 303. 

[0036] About each point in the image obtained by image acquisition equipment 2, the characteristic 
quantity calculation section 301 extracts image characteristic quantity of a predetermined number 
(the number of classes required for person detection), makes each image characteristic quantity 
correspond with the coordinate in an image, and outputs it. 

[0037] The characteristic quantity calculation .section 301 held, the model, i.e., the. person geometric 
model, of the configuration based on a person outline, and equips two or more points of having been 
beforehand set up on the person geometric model with 1 set of characteristic quantity detectors 
arranged in piles, respectively. Hereafter, 1 set of these characteristic quantity detectors are 
described as a characteristic quantity detector set. Therefore, it is synonymous with putting a 
characteristic quantity detector set on the location concerned to put a person geometric model on 
a location with an image frame. When discriminating the outline of a portrait image from the outline 
of other images so that the below-mentioned example may explain, a characteristic quantity 
detector set is constituted by the characteristic quantity detector (for example, edge detection 
operator) which has been arranged in two or more locations of the outline of a person geometric 
model and which identifies an outline. Moreover, for example, like a schoolboy, when discriminating 



the image of the person wearing a yellow hat from other images, the characteristic quantity detector 
which detects yellow in the predetermined location of the head of a person geometric model other 
than two or more characteristic quantity detectors which identify an outline is arranged. Thus, the 
characteristic quantity detector which constitutes a characteristic quantity detector set is set as 
the location where the characteristic quantity detectors of a different class according to the feature 
of the person who is going to extract differ. 

[0038] When putting this person geometric model (characteristic quantity detector set arranged to 
the person geometric model in detail) on each location of the image field which is going to detect 
the person of a static-image frame to be examined and extracting a portrait image, each 
characteristic quantity detector which constitutes a characteristic quantity detector set detects 
person characteristic quantity and other background-image characteristic quantity in the relative 
position corresponding to each part on a person geometric model. Each characteristic quantity 
detector of a characteristic quantity detector set evaluates the degree which performed the 
predetermined operation to the value of 1 set of image characteristic quantity (it is hereafter 
described as an image characteristic quantity set) detected while maintaining each relative position, 
and has agreed as proper [ an image characteristic quantity set ] as a person geometric model, and 
the evaluation value operation part 302 generates the evaluation value corresponding to the current 
position on an image frame of a person geometric model, the above — " — proper — " — a 
characteristic quantity detector — " — the inside of detection tolerance — it is — " — ** — it is 
the semantics to say. Moreover, "the location on an image frame of a person geometric model" is 
the coordinate on the image frame concerned of the representation point set as the arbitration of a 
person geometric model. Thus, the evaluation value operation part 302 generates the evaluation 
value image showing the evaluation value corresponding to each coordinate of an image frame. 
[0039] To the evaluation value image computed by the evaluation value operation part 302, the 
maximum point retrieval section 303 searches for the evaluation value maximum point that the 
evaluation value corresponding to the coordinate of the pixel concerned serves as max in a nearby 

field about each pixel of an image frame, and outputs the coordinate of the acquired evaluation 

value maximum point as a point that a person exists. 

[0040] There are various embodiments in the technique as which the evaluation value operation part 
302 estimates whether they are whether the person geometric model has agreed proper in the 
portrait image, and no. As one embodiment, there is the technique of making an image frame top 
scan about a person geometric model. In this case, if all the values of the characteristic quantity set 
in which each characteristic quantity detector of a characteristic quantity detector set carried out 
"it is coincidence mostly" detection are beyond predetermined thresholds, it will be judged as the 
person geometric model having agreed proper in the portrait image. It is the semantics that it is 
simultaneous with "being coincidence mostly" here within the time amount width of face which 
carried out division process of the aforementioned detection tolerance with the scan speed. 
Moreover, there is also the method of making carry out displacement of the characteristic quantity 
image which each of the characteristic quantity detector which constitutes a characteristic quantity 
detector set generates like the technique used in the example mentioned later by the displacement 
vector (characteristic quantity displacement vector) corresponding to the relative position between 
the characteristic quantity detectors concerned, and compounding it. 

[0041] Next, person detection processing (step A2 of drawing 2 ) is explained with reference to the 
flow chart of drawing 4 . As for the captured image, in the characteristic quantity calculation section 
301, the characteristic quantity about each point is computed first (step B1). Next, in the evaluation 
value operation part 302, a person geometric model is put on each location on an image frame to the 
obtained characteristic quantity image. From the set of the characteristic quantity obtained in two 
or more points beforehand set up on the person geometric model, the characteristic quantity 
evaluation value in said each location is computed, a characteristic quantity evaluation value is 
matched with the coordinate on the image frame corresponding to the location concerned, and it 
outputs as a characteristic quantity evaluation value image, (step B-2) . 

[0042] Processing from which the obtained evaluation value image extracts the point that the 
person in an image exists, in the maximum point retrieval section 303 is performed. The partial field 
centering on each pixel in an image is set up, and, specifically, it is searched for the maximum point 



that an evaluation value becomes max in the partial field concerned (step B3). The coordinate of the 
center of a partial field that the maximum point was acquired is outputted as a point that a person 
exists (step B4). 

[0043] Drawing 5 is the block diagram of one example of the person detection equipment of drawing 
3 . The person detection equipment of this example is equipped with the image differential section 
31, the evaluation value image composition section 32, and the maximum point retrieval section 33. 
The person detection equipment of this example is constituted for the characteristic quantity 
detector set by 1 set of edge detection operators fixed to two or more points of having been 
beforehand set up on the outline of a person geometric model, respectively, using an edge detection 
operator as a characteristic quantity detector of the person detecting element of drawing 3 . The 
image differential section 31, the evaluation value image composition section 32, and the maximum 
point retrieval section 33 are the examples of the characteristic quantity calculation section 301 of 
drawing 3 , the evaluation value operation part 302, and the maximum point retrieval section 303, 
respectively. 

[0044] The image differential section 31 is equipped with 1 set of edge detection operators 
constituted by maintaining the relative position corresponding to the predetermined location on the 
outline of a person geometric model (the following description describes an operator set 1 set of 
these edge detection operators). The operator set is constituted in this example, using the edge 
detection operator who detects the edge of x directions and the direction of y two sorts of size. 
Among these, a large-sized edge detection operator is stationed in comparison like the outline of 
the upper part of the body in the location corresponding to a portion large a form and flat, and a 
small edge detection operator is stationed like the outline of a head in the location corresponding to 
a portion with a small form and comparatively large curvature. Each edge detection operator is 
applied to the portrait image and background image which were obtained by said image acquisition 
section 2, and creates the differential image of these images. 

[0045] Although the edge detection operator who constitutes an operator set generates a 
differential image, respectively, each edge detection operator generates the differential image of the 
same image in the location where only these edge detection operators relative position shifted, 
therefore, the screen corresponding to [ when each edge detection operator generates a differential 
image on a separate screen ] each edge detection operator — an edge detection operators relative 
displacement and hard flow — a parallel displacement — carrying out — piling up (it compounding) 
— the same portion of the differential image of each screen laps. However, even if it carries out 
above-mentioned parallel displacement and synthetic processing, the portion (it is hereafter 
described as a different edge portion) from which the differential image with which each screens 
differ, or the same differential image differs will not lap, if those edge portions are not in a special 
relative position with which it laps by the parallel displacement and synthetic processing. If it puts in 
another way, an edge portion with the same relative configuration as an edge detection operator s 
relative configuration, i.e., the image corresponding to a person geometric model, will lap with 
coincidence by the parallel displacement and synthetic processing. This example extracts only the 
differential image of a portrait image from a differential image side by this principle. 
[0046] The evaluation value image composition section 32 the differential image corresponding to 
each edge detection operator obtained by said image differential section 31 Carry out the parallel 
displacement only of the vector and it sets on each coordinate in each differential image side, an 
edge detection operators displacement to the origin/datum set up on the person geometric model . 
side at arbitration — the inverse vector of a vector, i.e., characteristic quantity, — displacement — 
An evaluation value image is created as an evaluation value [ in / for the product of the edge value 
(displacement characteristic quantity) of the differential image by which the parallel displacement 
was carried out / the coordinate ]. The maximum point retrieval section 33 outputs the location of 
the pixel which exists at the center of a partial field that the maximum point which sets up the 
partial field centering on each pixel in the evaluation value image obtained by the evaluation value 
image composition section 32, and searches for the maximum point that an evaluation value serves 
as max in a partial field, among those exceeds a predetermined threshold exists as a location of the 
point that a person exists. 

[0047] Drawing 6 is drawing showing the edge detection operator used by this example. This 



operator is an edge detection operator currently indicated by Japanese Patent Application No. 11- 
152381. As compared with the conventional Sobel operator, the width of face of a gap field without 
weight of the center of an operator is extended, and an operators magnitude is also larger than a 
several pixel x. number pixel and the conventional thing as shown in drawing 6 . Since an image 
changes with sense to a camera even if a configuration changes with persons and it is the same 
person, the reason for having extended the width of face of a gap field without central weight is for 
giving permission width of face in the location and direction of an edge which an operator detects, 
and detecting neither configuration change of such a person nor change of the image by the sense 
to a camera. 

[0048] Every two sorts of size and a total of four sorts are prepared for such an edge detection 
operator about each of x directions and the direction of y. These operators are used according to 
the configuration of the outline of ah image so that it may be later mentioned with reference to 
drawing 7 . The differential image which makes the differential value in each coordinate a pixel value 
is created by applying the operator set constituted by this edge detection operator to each location 
of the whole image obtained by the image acquisition equipment 1 of drawing 1 . 
[0049] Drawing 7 is drawing showing the person geometric model of this example, and arrangement 
of an edge detection operator. The small operator who detects the edge of the direction of y at the 
point A equivalent to the parietal region of the person outline shown in drawing 7 is stationed, and 
the small operator who detects the edge of x directions at the points B and C equivalent to head 
right and left, respectively is stationed. The large-sized operator who detects the edge of x 
directions, respectively is stationed at the points D and E equivalent to idiosoma right and left. 
Thus, like a head, for an outline with a small form, a small operator is stationed and the large-sized 
operator who detects a wide range straight line outline is stationed like the outline of idiosoma at 
the portion in which a form has a flat large outline comparatively. Five operators stationed like 
drawing 7 maintain this relative position, and operate as an operator set. 

[0050] Next, the person detection processing in this example is explained. Drawing 8 is a flow chart 
which shows the flow of person detection processing of this example. Differential processing is 
performed by the edge detection operator of x directions and the direction of y from whom the 
image captured by image acquisition equipment 2 (refer to drawing 1 ) constitutes [ in / first / the 
image differential section 31 (refer to drawing 5 ) ] an operator set (step C1). Next, the differential 
image (the example of drawing 7 differential image of five sheets) created by each edge detection 
operator is set in the evaluation value image composition section 32, and the parallel displacement 
and composition of it are done according to the person geometric model beforehand set up 
according to a person's configuration and magnitude in an image as shown in drawing 7 . 
[0051] The differential image got by the small operator who detects the edge of the direction of y at 
the point A which is specifically equivalent to the parietal region of the person outline first shown in 
drawing 7 is made to correspond. The differential image got by the small operator who detects the 
edge of x directions at the points B and C equivalent to head right and left, respectively is made to 
correspond, and the differential image got by the large-sized operator who detects the edge of x 
directions at the points D and E equivalent to idiosoma right and left, respectively is made to 
correspond, respectively. 

[0052] Next, the parallel displacement of each differential image corresponding to each point is 
carried out using the displacement vector which goes to Origin/datum O from each point in the 
above-mentioned model (step C2). In the example of drawing 7 , the differential image by the small 
operator of the direction of y corresponding to the parietal region A displaces only the vector which 
goes to the head central point O used as an origin/datum. That is, a parallel displacement is carried 
out to an image lower part (this parallel displacement is calculated by coordinate transformation). 
[0053] Furthermore, each differential image which carried out the parallel displacement is piled up, 
the product of the pixel value (displacement characteristic quantity) of the pixel which exists in the 
same coordinate about all the coordinates in each image is computed, and an evaluation value image 
is compounded as a pixel value [ in / for the product / the coordinate concerned ] (step C3). 
[0054] Thus, processing from which the evaluation value image obtained by the evaluation value 
image composition section 32 extracts the point that the person in an image exists, in the maximum 
point retrieval section 33 is performed. The partial field centering on each pixel in an image is set 



up, and, specifically, it is searched for the maximum point that the evaluation value in the pixel 
concerned serves as max, in the partial field concerned (step 04). Among those, the coordinate of 
the pixel of the center of a partial field with the evaluation value exceeding a predetermined 
threshold is outputted as a point that a person exists (step C5). 

[0055] drawing 9 — the person counter 4 of drawing 1 , and counting — the result storage 5 and 
counting — it is a conceptual diagram for explaining the example of the result display 6. 
[0056] the field in which the location and sense of a camera serve as a candidate for a monitor into 
the image acquired with a camera as are first shown under the environment fixed completely by this 
example at drawing 9 — one — or more than one are set up. And it judges whether the location of a 
person's head obtained with the person detection equipment 3 of drawing 1 is in each observation 
field, and the number is outputted according to each observation field. 

[0057] Assembly U={ui of a pixel considered to be the center position of a person's head which is 
the person counter 4 and was obtained with said person detection equipment 3 as processing, and 
vi|i integer} from 0 to the total number -1 Everybody object observation field Vj= {(u, v) |tbj<=u<=ttj, 
tlj<=v<=trj} (the integer from 0 to the person observation field total -1, and tbj, t1j, tlj and trj j) 
Respectively, it judges whether close is in the j-th coordinate threshold of down [ of a field ], above, 
the left, and the right, and the number is outputted according to each field about what is in close. 
The person counter 4 carries out counting of the number of persons in each set-up field from the 
detection result obtained by said person detection equipment 3. 

[0058] counting — the result storage 5 is related with the time of day which picturized the image, 
and is serially recorded according to each field set up in the number of persons by which counting 
was carried out with the person counter 4. counting — the person in the image to which counting of 
the result display 6 was carried out with the person counter 4 — counting — a result or counting — 
the person in the time of day of the past accumulated in the result storage 5 — counting — it 
displays by processing a result according to each set-up field if needed. 

[0059] By this example, about the large-sized facility which a lot of people, such as a concert hall, a 
ball game facility, and an art gallery, use, the circumferences, such as each entrance or a display 
object, are beforehand set up as a processing-object field, counting, such as those who appreciate 
each display object in those who gather around an entrance, those who have ranked with the bus 
stop, or an art gallery, becomes possible, and usefulness can be raised. 

[0060] Drawing 10 is the block diagram of one example of the person counter 4 of drawing 1 . The 
person counter 4 (refer to drawing 1 ) of this example is equipped with the person location detecting 
element 41, the storage section 42 corresponding to an image and a location, and the person 
densitometry section 43. Before the storage section 42 corresponding to an image and a location 
measures with person location detection equipment 41 by memorizing the look-up table which 
indicated the value of a parameter required to presume the location in a person's real space, or the 
spatial position of a pixel and a person, it performs a calibration (proofreading) by initial setting in 
advance, takes correspondence with each pixel in an image, and a spatial position, and it memorizes 
it beforehand. 

[0061] The person location detecting element 41 considers as it is that the output of person 
detection equipment 3 (refer to drawing 1 ) is the location of the head in an image, and presumes 
the location in a person's space based on the information on the storage 42 corresponding to an 
image and a location. The person densitometry section 43 measures the number in a very small field 
based on the person location detected by the person location detecting element 41. counting — the 
person density measured by the person densitometry section 43 is related with the time of day 
which picturized the image, and the result storage 5 (refer to drawing 1 ) records it serially, counting 
— the person density in the image by which the result display 6 (refer to drawing 1 ) was measured 
with the person counter 4, or counting — the person density in the time of day of the past 
accumulated in the result storage section 5 is processed and displayed if needed. 
[0062] Hereafter, the calibration method which the storage section 42 corresponding to an image 
and a location performs is described. First, in the preparation phase of a calibration, it asks for the 
internal parameter (a focal distance f, the distance dh between horizontal pixels, the distance dv 
between perpendicular direction pixels, an image center (uc, vc), the number of distortion 
aberrometers) of a camera beforehand. Although there are various these internal parameter 



calculation methods What is called the technique of Tsai is the general-purpose. It is (reference:). 
[ Roger Y. Tsai, ] [ "An ] Efficient and Accurate Camera Calibration Technique for3D Machine 
Vision", Proceedings of IEEE Conference on Computer Vision andPattern Recognition Miami Beach, 
floor line 1986. 

[0063] Next, the camera location and posture in space are presumed as follows on the assumption 
that these interior parameter is known (the camera location in space and the thing of a posture will 
be hereafter called an external parameter). Model drawing of the space which measures camera 
arrangement and a person location to drawing 1 1 is shown. The zero O in the lower right of drawing 
JM[ is a zero of a global coordinate system, and defines a xyz shaft like drawing 1 1 for convenience. 
Each point (xi, yi, t) (however, i= 1...5) of drawing 11 decides length beforehand to become the height 
(from a floor line to about 140-1 60cm) to which the point of the pole hits the center of an exactly 
common person's head with the pole stood for the calibration. (Although the thing which the relative 
position in space understands independently and which set up similarly by five points is also 
possible, such five points are beforehand set up from a viewpoint which raises precision) As a range 
which presumes a person location, it considers as the field surrounded by four points (xi, yi, t) 
(however, i= 1...4) of drawing 1 1 again. A camera shall have a lens center in (xO, yO, zO) of a global 
coordinate system, and to the positive direction of the z-axis, further, an optical axis shall have only 
an angle alpha in the circumference of the y-axis at an inclination and the angular position (posture) 
which rotated around the z-axis so that an angle beta may be made to a x axis, (uc, vc) — an image 
center (point that a camera optical axis and an image side cross) — it is (i(ui, vi) = 1...5) — it is the 
coordinate (coordinate of the image point on an image side) of the pixel which the object point (xi, 
yi, t) (i= 1..5) was picturized, and was reflected. 

[0064] At this time, the global coordinate (Xi, Yi, Zi) of the point on an image side (ui, vi) (i= 1..5) 
becomes settled as follows. First, [0065] 
[Equation 1] 
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[0066] It is [0067] to ui' and vi' which are obtained as be alike. 
[Equation 2] 

'cos p - sin (J 0 Y cosa 0 sin a ' 

0 



sinP 
0 



COS0 

0 



rV U ^ 



A 



-sin a 



1 

0 



cosa 



a~0 



fx ^ 




'cosacosp 


-sinp 


sinacosp > 






Yo 


+ 


cosa sinp 


cosp 


sin a sin p 




(2) 






^ - sin p 


0 


cosa j 


W 





[0068] **********. Here, kappa is a distortion aberration coefficient. (Distortion aberration is 
aberration which an image is distorted to a slack type or is distorted in a spool mold, when a grid- 
like body is photoed with a camera.) Although ui-ds (ui-uc) is realized in the camera model of the 
usual transparent transformation, since distortion aberration exists in-the case of a common 
camera, a transparent transformation model is not necessarily realized. A formula (1.1) is a formula 
for amending it. 

[0069] it obtains from a formula (2) — having (Xi, Yi, Zi) — the following straight line [0070] 
[Equation 3] 
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[0071] It is upwards. Therefore, a degree type is realized. 

[0072] 

[Equation 4] 



(X i -x i )(z o -t)-(Z i -t)(x o -x i ) = 0 
(Y i -y l )Czo-t)-(Z i -t)(y 0 -y i ) = 0. 
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[0073] A formula (2) to (Xi, Yi, Zi) are a degree type [0074]. 
[Equation 5] 

[0075] ** — like — xO, yO, z0 f alpha, and beta — and (ui\ vi') (i= 1, 2..5), since it is expressed if a 
formula (2) is substituted for a formula (4.1) and a formula (4.2) — a formula (4.1) and a formula (4.2) 

— and (xO, yO, z0 t alpha, beta) (ui\ vi') it is expressed (i(xi, yi, t) = 1, 2..5). Among these, (i(xi, yi, t) = 
1, 2..5) it is set up beforehand, and since it is a point, the value is known. Moreover, (i(ui\ vi') = 1, 
2..5), the value is known by putting a body on a coordinate (xi, yi, t) (i= 1, 2..5), and picturizing 
beforehand. Therefore, five kinds of equations (4.1) of an about (xO, yO, zO, alpha, beta) and an 
equation (4.2) are obtained to five values of i. The probable value of five parameters xO, yO, z0, 
alpha, and beta can be acquired from these five equations with the least square method. 

[0076] With the least square method, in order to presume the location (xO, yO, zO) of a camera, and 
the probable value of a posture (alpha, beta), the sum of the square of the left part of a formula (4.1) 
and the square of the left part of a formula (4.2) is taken, and it is set to S (ui\ vi'). The probable 
value of five parameters xO, yO, zO, alpha, and beta is calculated with the least square method which 
used S. a thing typical about such the non-line type least square method — Marquart — law — it is 

— William H. Press et Explanation is given to the .505-510 page of translations "new MERIKARU 
recipe Inn C" (technical Hyoronsha 1993), such as al. work and Haruhiko etc. Okumura, in detail. 
Since this application and relevance are thin, the contents of the non-line type least square method 
omit explanation here. xO, yO, zO, alpha, and beta which were obtained by the above are stored in the 
storage 42 corresponding to an image and a location, and end a calibration. 

[0077] Next, processing of person location detection equipment 41 is explained. Suppose that the 
pixel (u, v) considered to be the center of the head of the person in the inside of an image was 
detected by person detection equipment 3. this — the time — this — a pixel — a global coordinate 
system — a coordinate value (xp, yp, zp) — a formula (1.1) — a formula (1.2) — being the same — 
deformation — having carried out — the following — ( — u — 1 — v — ' — ) 
formula — ( — five — ) — like — expressing — having . 
[0078] 
[Equation 6] 

«' = d k • {l +■ *((!< - »c) 2 + ((v - v c ) 2 )}. (;/ - v c ) (1 .3) 

v 1 = d k • { + k ((ii - u c ) 1 + (( v - v c f )}• ( v - \> c ) (14) 



receiving — a 



[0079] 
[Equation 7] 



r *S\ fx n } fcosp -sinJJ 0 



p 



Yd 



cosa 0 

ship cosji 01 0 1 
0 0 1 A - sin a 0 

^cosacosP -sinp sinacosP 
cosa sin p cosp sin asin P 
-sinp 0 cosa 




[0080] When it considers that this person's height is t, the global coordinate (x y, t) of a person 
location can be expressed like the degree type (6) which transformed the equation of the straight 
line of an equation (3). 



[0081] 
[Equation 8] 

*, - *o y, - y w z P - 2 o 

[0082] From this, the global coordinate of a person location is [0083]. 
[Equation 9] 

x = M*. -jr 0 ) + x 0 

z p- z > 

y = ±l52- { y y o) + y 0 (7 ) 

p 0 

[0084] It asks by carrying out. The person location detecting element 41 outputs the coordinate 
value which carried out in this way and was calculated (x y, t) to the person densitometry section 
43. 

[0085] Moreover, in order to accelerate processing of the person location detecting element 41, 
count from (1.3) to (7) is performed in advance about all the pixels in an image, the look-up table is 
recorded on the storage section 42 corresponding to an image and a location, and there is also a 
method of receiving having asked with person detection equipment 3 (u, v), and searching for the 
global coordinate (x y, t) of a person location with reference to a look-up table. 

[0086] Next, processing of the person densitometry section 43 is explained. Drawing 12 projects the 
location in the real space of the everybody object obtained by the person location detecting 
element 41 on xy plane, and is drawing showing the plotted example. Since the field surrounded by 
four points (xi, yi, t) (however, i= 1..4) of drawing 1 1 is beforehand set up as a field which presumes a 
persons location, seeing, although it is in the field is shown in drawing 12 . Drawing 13 divides this 
field into 36 small fields, and shows how many persons there are according to each field. Although 
this drawing divides into the field of the almost equal magnitude of 36 pieces and is shown and made 
into it, it is not necessary to be a rectangle like drawing 13 , and the field which can set up freely 
according to a use and presumes a person's location has also responded to a use, and, as for the 
number and each area size of a field, can set up area size and a configuration freely. In drawing 13 , 
in order to identify each field, a field 1 - a field 36, and an identifier are given, and each field is 
defined as Si= {(x y) |xl[i] <=x<=xr[i] yb[i] <=y<=yt [i]} (i is 1 .. integer to 36). Here, xl [i] and xr [i] are 
the x-coordinates of the left end (left part) of Field i, and a right end (right-hand side), respectively. 
Similarly, yb [i] and yt [i] are the y-coordinates of the lower limit (lower base) of Field i, and upper 
limit (raised bottom), respectively, the value in the global coordinate system of an everybody object 
location — then G (xj. yj) is a value from 1 to a person total), suppose that the time (xj, yj) of **(xj, 
yj) Si exists in Field i. the number of the persons who exist in it about each field by such method — 
calculating — the result — counting — it outputs to the result storage 5 (refer to drawing 1 ). 
[0087] the person density result by which counting was carried out with the person counter 4, and 
counting — the person in the time of day of the past accumulated in the result storage 5 — 
counting — a result counting — that the graph which showed the size of density like drawing 14 by 
the shade of an image, corresponding to a demand of necessity or an operator shows the result 
display 6 **** (in drawing 14 , although the shade is expressed as the slash) It is displayed by 
performing various processings, such as graph-izing change of the density according to time amount 
of each smallness field displayed in a color in fact. This example is useful to measurement of the 
person density in an extensive field like drawing 14 , for example, measurement of the confusion 
condition of a platform etc. 

[0088] the next — counting of drawing 1 — one example of the result display 6 is explained, drawing 
15 — counting — it is the block diagram of the 1st example of the result indicating equipment 6. 
the wide angle camera which can overlook the whole interior of a room of a store in this example — 
image acquisition equipment 2 (refer to drawing 1 ) to an image — acquiring — counting — the 
result storage 5 records the number of customers which came to the store at the store with image 
acquisition time of day. 



[0089] The number storage section 602 of purchase visitors has memorized the number of purchase 
visitors per unit time amount over all business hours based on the data recorded on POS etc. the 
rate display section 601 of purchase — counting of drawing 1 — according to predetermined 
conditions, such as a time amount exception or a day-of-the-week exception, the rate of purchase 
(the number of purchase visitors / the number of coming-to-the-store visitors) is totaled based on 
the number of purchase visitors memorized by the number of coming-to-the-store visitors per 
[ which was memorized by the result storage 5 ] unit time amount, and said number storage section 
602 of purchase visitors. 

[0090] drawing 16 — counting — it is the block diagram of the 2nd example of the result indicating 
equipment 6. the wide angle camera which can overlook the whole interior of a room of a store also 
in this example — image acquisition equipment 2 (refer to drawing 1 ) to an image — acquiring 
counting — the result storage 5 records the number of customers which came to the store at the 
store with image acquisition time of day. 

[0091] The number storage section 612 of employees memorizes the number of employees which is 
working at each time of day. the average reception numeral section 611 — counting — according to 
predetermined conditions, such as a time amount exception or a day-of-the-week exception, the 
number of reception per employee (the number of coming-to-the-store visitors / the number of 
employees) is totaled and displayed based on the number of employees memorized by the number of 
coming-to-the-store visitors and the number storage 612 of employees per [ which was memorized 
by the result storage 5 (refer to drawing 1 ) ] unit time amount. 

[0092] drawing 1 7 — counting — it is the block diagram of the 3rd example of the result indicating 
equipment 6. the time of photoing the inside of a store and obtaining an image in this operation, — 
the predetermined register circumference beforehand — as a processing-object field — setting up 
— the person counter 4 — the person in a respectively predetermined field — counting — carrying 
out — counting — a person [ in / on the result storage 5 and / each field ] — counting — a result 
is recorded with image acquisition time of day as the number of the customer on a par with a 
register. The number storage section 622 of the registers used memorizes the number of registers 
currently used for each time of day. The number KONSARUTO section 621 of registers reads the 
contents memorized by the number storage section 622 of the registers used. The number of 
registers memorized by the number of optimal registers and the number storage of the registers 
used which are presumed from the customer number on a par with a register is compared, and it 
totals and indicates whether the number of registers currently used for every time of day has 
exceeded the required number, or be less according to predetermined conditions, such as a time 
amount exception or a day-of-the-week exception. 

[0093] drawing 18 — counting — it is the block diagram of the 4th example of the result indicating 
equipment 6. In this example, a specific counter is beforehand set up as a processing-object field, 
the inside of a store is photoed, and an image is acquired, the person in a field predetermined in the 
person counter 4 — counting — carrying out — counting — a person [ in / in the result storage 5 / 
each field ] — counting — a result is recorded with image acquisition time of day as the number of 
the customer who is in a specific counter. 

[0094] The employee storage section 632 in a counter memorizes the number of employees 
arranged at each time of day at the above-mentioned counter. The number KONSARUTO section 

631 of the employees in a counter reads the contents of storage of the employee storage section 

632 in a counter. The number of employees memorized by the number of optimal employees 
presumed from the customer number in a specific counter and the number storage of employees is 
compared, and it totals and indicates whether the number of employees arranged for every time of 
day has exceeded the required number, or be less according to predetermined conditions, such as a 
time amount exception or a day-of-the-week exception. 

[0095] drawing 19 — counting — it is the block diagram of the 5th example of the result indicating 
equipment 6. With this operation gestalt, the predetermined circumference of a lift bus stop or the 
circumference of an entry of an attraction facility is beforehand set up as a processing-object field 
about the image which photos the inside of play facilities, such as a skiing area or an amusement 
park, and is obtained. 

[0096] The person counter 4 carries out counting of the person in a predetermined field, 



respectively, counting — a person [ in / in the result storage 5 / each field ] — counting — a result 
is recorded with image acquisition time of day as the number of the customer on a par with a lift or 
an attraction facility. The unit time amount processing number storage section 642 memorizes the 
number which each lift or an attraction facility sells to per unit time amount. The latency-time 
display 641 reads the contents of storage of the unit time amount processing number storage 
section 642. Each lift or attraction facility memorized by the number and the unit time amount 
processing number storage section of the customer on a par with a lift or an attraction facility which 
were recorded from the number sold to per unit time amount In image pick-up time of day, a 
customer computes the latency time (number which a facility sells to the number / unit time 
amount of the customer who has stood in a line) over service of the facility concerned, and displays 
the latency time computed to the bulletin board formed in the every place point of play-facilities 
inside and outside. 

[0097] About the gestalt of each above operation, it can carry out by changing conditions suitably, 
for example, there is no limit in the number of cameras, an edge detection operator's weight 
configuration and the width of face of a gap, the configuration of a person model, arrangement, the 
number of a point to choose, etc. 

[0098] Person detection processing by person detection equipment shown above is performed under 
control of the processor by which this is not illustrated, either according to the person detection 
program currently recorded on the record medium which is not illustrated. 

[0099] Person detection program of this invention Image acquisition processing which incorporates 
the image frame photoed with the camera which photos the field where many persons exist or move, 
and creates the image in which an image processing is possible, Hold a person geometric model, 
extract the image which has a configuration corresponding to a person geometric model from the 
image in which said image processing is possible, and each extracted image as a person currently 
picturized all over the image side The person detection processing which outputs the coordinate on 
an image plane of the point of representing the location where the extracted everybody object 
exists, the person who does counting of the number of persons which exists in the field of view of 
an image side from the person detection result obtained by the person detection means — counting 
— with a means a person — counting — counting which relates the number of persons by which 
counting was carried out with the time of day which picturized the image, and records it serially with 
a means — with result storage processing a person — counting — the person in the image side by 
which counting was carried out with the means — counting — a result or said counting the 
person in the time of day of the past accumulated in the result storage means — counting - 
counting which processes and displays a result if needed — the procedure for performing result 
display processing is described. This person detection program in order to make a computer perform 
said person detection processing With the characteristic quantity detector set which becomes with 
1 set of characteristic quantity detectors arranged in the relative position corresponding to the 
location of two or more points of having been beforehand set on the person geometric model as the 
computer In the relative position corresponding to each location on a person geometric model Image 
characteristic quantity is detected about each point of the image side acquired by image acquisition 
processing. Characteristic quantity calculation processing which the detected image characteristic 
quantity is made to correspond with the coordinate of an image side, and outputs it is performed. A 
predetermined operation is performed to the value of the image characteristic quantity set with 
which each characteristic quantity detector of a characteristic quantity detector set becomes with 
1 set of image characteristic quantity detected in said relative position. The degree to which the 
image characteristic quantity set has agreed with the person geometric model proper is evaluated. 
An evaluation value is generated corresponding to the location on an image side of a characteristic 
quantity detector set. Evaluation value data processing which generates the evaluation value image 
showing the evaluation value corresponding to each coordinate of an image side is performed. As 
opposed to the evaluation value image computed by evaluation value data processing about the 
pixel of each coordinate of an image side The procedure for performing the maximum point retrieval 
processing which searches for the evaluation value maximum point that the evaluation value 
corresponding to the coordinate of the pixel concerned serves as max in a nearby field, and outputs 
the coordinate of the acquired evaluation value maximum point as a point that a person exists is 



described. 
[0100] 

[Effect of the Invention] The 1st . effect is the point which can detect the person in an image, 
permitting the difference in a very small configuration, and change. The reason is because a high 
differential output value will be acquired if an outline is in an operators gap portion even if it 
changes an outline configuration very small, and a high evaluation value can be acquired as a result 
by using the edge detection operator who extended the gap. 

[0101] The 2nd effect is the point that each people can be separated and detected, even when the 
candidate person adjoins mutually. The reason is that it is hard to hide even when comparatively 
crowded with the target person groups, and a characteristic quantity detector can be arranged by 
the ability using the outline configurations of comparatively few heads of configuration change, and 
the upper half of the body as a model, and it can perform person detection processing. 
[0102] The 3rd effect is the point that improvement in the speed by hardware mounting is easy. 
Since the reason constitutes person detection equipment focusing on filtering of the whole image, it 
is because it is easy to attain improvement in the speed of processing with the application of the 
hardware only for image processings using DSP etc. 

[0103] There are few 4th effects about the constraint to the installation conditions of a system, and 
the flexibility in employment is a high point. The reason is because it is [ migration of a camera or ] 
hard to be influenced of lighting change, unless change of the configuration within the image of the 
personcurrently picturized is remarkable and there is, in order to use a person's configuration. 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation* 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.ln the drawings, any words are not translated. 



DESCRIPTI ON OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing 1] It is block drawing showing the configuration of 1 operation gestalt of this invention. 
[Drawing 2] It is the flow chart which shows the manipulation routine of the operation gestalt of 
drawing 1 . 

[Drawing 3] It is the block diagram showing the configuration of the person detection equipment 3 of 
drawing 1 . 

[Drawing 4] It is the flow chart which shows the flow of the person detection manipulation routine of 
person detection equipment 3. — 
[Drawing 5] It is the block diagram showing the configuration of the person detection equipment 3 of 
drawing 1 . 

[Drawing 6] It is the conceptual diagram showing the edge detection operator used in person 
detection equipment 3. 

[Drawing 7] It is the conceptual diagram showing arrangement of the person outline geometric model 
used for person detection processing, and an edge detection operator. 

[Drawing 8] It is the flow chart which shows the contents of the person detection manipulation 
routine using an edge detection operator. 

[Drawing 9] It is the conceptual diagram showing one or the example set up for the field used as the 
candidate for a monitor in the image acquired with a camera. [ two or more ] 
[Drawing 10] It is the block diagram of one example of the person counter 4 of drawing 1 . 
[Drawing 1 1] It is drawing showing the model space for proofreading camera arrangement and a 
person location. 

[Drawing 12] It is sample drawing which plotted the person location in the space before processing 
with the person density metering device 9. 

[Drawing 13] It is drawing showing the example of each smallness field processed with the person 
density metering device 9. 

[Drawing 14] counting — it is an example of person density drawing displayed with the result display 
6. 

[Drawing 15] counting — it is the block diagram of the 1st example of the result indicating 
equipment 6. 

[Drawing 16] counting — it is the block diagram of the 2nd example of the result indicating 
equipment 6. 

[Drawing 17] counting — it is the block diagram of the 3rd example of the result indicating 
equipment 6. 

[Drawing 18] counting — it is the block diagram of the 4th example of the result indicating 
equipment 6. 

[Drawing 19] counting — it is the block diagram of the 5th example of the result indicating 
equipment 6. 

[Description of Notations] 

1 Camera 

2 Image Acquisition Equipment 

3 Person Detection Equipment 

301 Characteristic Quantity Calculation Equipment 



302 Evaluation Value Arithmetic Unit 

303 The Maximum Point Retrieval Equipment 

31 Image Differential Section 

32 Evaluation Value Image Composition Section 

33 The Maximum Point Retrieval Section 

4 Person — Counting — Section 

41 Person Location Detecting Element 

42 Storage Section corresponding to Image and Location 

43 Person Densitometry Section 

5 Counting — Result Storage 

6 Counting — Result Display 

601 Rate Display of Purchase 

602 The Number Storage Section of Purchase Visitors 

611 Average Reception Numeral Section 

612 The Number Storage Section of Employees 

621 The Number •K ONSARUJO Section of Registers 

622 The Number Storag^Section of Registers Used 

631 The Number KONSARUTO Section of Employees in Counter 

632 The Number Storage Section of Employees in Counter 

641 Latency-Time Display 

642 Unit Time Amount Processing Number Storage Section 
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*w:T*uyic3>*^h*i:*#1-*,-«l*JI8fcB 

14] A*tHR*at:Aot»6ixfctHR« 
*fct±tllBtHWe*E«*»C*«**ifcii*©W 

sij©w-scie»&> efcfiKjss b-c*Dx u«a**ff a tHRts 

3» #Rf*Jfc±E05WfcKB*n , CV^fie*H»*B«t- 

«*n*«isesisfti:«e3i*»B«a«fc:B«$nfc 

;^^g^5^:^:#■r4^ »*«8^e«©^b. 

^> *fctt«fBt^*B«*at***n&a*©i« 

A»&B«f5¥(4«rmi«KIA*EftiJi: U 7 ^ife4V^ 

j|Mtti*nwffiiA»Bit»cBii*nfc*'j 7b*fc»7 
imMiz&^xm%tmmmi&(Dy-vz{ztti-zm*> 

» 5MRfc ^ c » a b tz& ?>m?$ * zftttif mm™ 

so SBi:**-rsii^8{rE«©^Bo 
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m&m 1 6 ] %®.(Dxya#&iL&tz\mm? 
zmm-r z t> * 5 c i t> xm&z titzw&? w - a 
d ii^•r•li^ts^ls^Itg*Il^ : &^fi£t-?>li^3l^#^!!!iS 

^ Afcjfctt^xJUfeftJSU UBBifiMtta^rilB*Iiift 

&a©*a#rt c#s-r a a«r & w«r a a»3HR*« 

A*^^«fc«fc^Ttr**ftfcA4»Rfc, OMfcfc 
^bfcB*MfcWJtM-tf\ X&RfltrsiHfcttJIllBlttt 

©RttKftt* S A4MHKBJR*. sM?fc*S fctiox bt 
SnT^SA1i*a:7n^5AfcIB*bT^SI3»Itt 

AW^^x;idt©^toi^$ftfc&&©ja©(iBfcft 
fiM5llWDfflCJ;t>T»6nfelB«liiI©ft^t^v^Tll«l 

h©*fcBrj£©***jfib-c, iamtt«» iva® 

lfflffeffi©5fis«©ll!*fcoi>T % ££&EH3R©ffiaiK:#J& 
j&*«*U W&ftfcaTOttS^casfllfcAlfe©^ 
©^ Jt#aBifi£ tit v> S c i: ill - 5 A^m 7p 

[0 0 0 1] 

ttrtft'^fc^v^w^ns^RcAUj^SMfednfeiiia 

[0 0 0 2] 

[ft*©&ffi] Mfc©A«rtW»ShfcM*&A1Wl 



(4) 

s 

[0 0 0 3] ;:n&©ttll5*fflv^TDifift»t»©a» 

AttfttHR-rSWfcUTtt, 4WP9-2 8 1 60 5t 

^my << t»flfc*nfcA«*jBifitttHjMi*fflv^T 

M¥8- 1 2 3 9 3 5Ktt> HKfe^fc^©^^^ > 

«*Md*froT»e)nfciii<fe*«Fiffl*iqifca[ 
©SjW*^^e»itii^ifii* J i i !i«-rs^ffi^ia^^m: 

[0 0 0 4] A*©««*tWr««fcUT 
tts 1 -24 4 5 9 8 £it*M#K «fc D A»«* 

aau ^ g D-^^it^iBitotta^a 

[0 0 0 5] 

t±, aftoAftiac^v^risi-rsflwaiacBiBtcwiii 
-ett, i«KbrsM6*n5A«ftKS'JbTtta-rac: 

©affl ait b v ^ 1 <, % a rsm « . 

[0 0 0 6] ^fcm«M#©i§-£T-«U lffl§fe*T?B* 

D-&dassc©A**-- 3©«akut«i!)a-rfc«>, # 
3o ©s^tBu a^, aa*nfc««©is**-A^fct) 

©H*TJi!l4ii:CJ:or*J: j e©Aftft}i^ , r**ia 

©A«©ffl5fcfifc &-&5ffi«*&A«ffl*S£*^ 
*i«H#**<JE»«:tr«ttHlfr*t»fc- 
[0 0 0 7] fcfc, £R©A*J*IMfrr*tt«©*>i:-C 

fttK H-A*rtfc^T*»Il«^©^*fl3B:*S^ 
©T\ ^^^©Jtffl biPo feo 
[0 0 0 8] *»ra®i«tts ^jRoAtt^JS^nfe 

*S*«fcU««ftfflv>t«l»«fcA«IH»» SlflJKH-«iJ 
[0 0 0 9] 

[8HH*»ft1-5 &«>©*«] ±i2©aM4)§¥^1-Sfc 



r 
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i>4&&tiK2W-r4&ffig£gv^ mimM^tzM 

ffcfflHflM«Mlffl«ttlftffV\ «iaB#(ft«K'*V>TW« 

4$&g©fitc:«^T, ttadn&BMfe«faui^ 
#1-4 Bffe(z>tt sat? * a £ k * jfaistf 5 &©m£© 

***£frU Stf?*S*#, i!5BB&ls£ftfcii&^S 
#iwfB AWBtt^JWfc 6»-f 4 frT 5 H^O^ 
®*f&4Cl£:£*b £B(&S£A*lII& 

[0010] wBB<oi5fso«iitt% <Nfm»&ms§-tr * b 

tifflUk©tt£ttlFU *©**»r£©Htti:JfcttU * 
[0011] BrIB©l9rJ£©**© 1 ^©laBBWk b 

■t, ^m;e©sii?«> *ft*n©i«wMfttu«#iftajb 

U 5 W«frWffj£©b*VMSfcjH*. 

[0012] fjga-en^nowfRitftwstfttajbfcW 
«sftfe*ti*ft©tt««i*ws*, Ms^AWtf^fr 

U iit3At)ff^ ; E^;i/±©mIi3^»t9;^$tifc^© 
£©#»&»&, AKJJBtt^T^fcttfcfcS^b&fiifcSt 

iWH»*«ttfflb&w«i*V ^©^»* s ^tH^n&^ 
[0013] #s§iii© Afj&mssgii, %®t<DAm*& 

1- 4 &©* B&¥E±££tt4&ti£m 



[0 0 14] A«£tB!£g{±> AttJBtttT^©** 

8!ks*ti&a»©iS©(ftBt»jai-r«ffl*r(ftBK:ii«* 
ntv>4 iia©«««ttm»Tfft4«fa«tta«-b , f h 

7 s ju±t43it*-tn-'E'n©(ft«c>*i6'r*ffi»(ftac* 
■flfcB©awi:»ft**"ta*-r*i«wM(tiij«k* w 

■0 ^ft&Wgl-t? v h ©«««*tH»*IWatt*Mft«fc* 
^TtftU bfc 1 ifiClj^^ST-^SiBmi^CS-b v h 

tt^^l/fcaUEfc^SbT^aflt&^StfPMBU ttfltt 
*ffl»tyb®, ■#H±fc*B-»(ft«C*t*L , riMli 
tt*£j«U HI<l®©#£»CttJS*-4fffiMte&'*-» 

oT*w3ftfcffffittHfcc**u iBflia©AStt©iB . 

»• fcffMDi«a^©*«ft A^©#*i-?>^t btai^t- 

[0015] mutiicmffitt, ^stftms-fe * h t b 
r i<fl©3iys;ifttH^i/— ;^t3&4*^i/— *-fes> h 

©*JP±fc43»t4*ft©ffi«C*t'i6'r*ffi»*ft«C*V^ 

t, iB<feai^atj;o-c»e»nfciiffeffl©#iSc^i^ 
THfcm«©*tti*fTV\ i*a$nfeiBiWft»©ttffi«[ 

*Mflfeia©ffi*Sl:>**6**"Cta*U fHffifiMWffitt-. 
ifllBlMRWSJI'fe » h©fBt*f-r4Rlr^©«»^ It, 

— * bfcx « yttattc-o^Tofcttwatt©* 

nfclMlWnWrt©#H***Afc^«J8I?HR«*»J6 

ff«t* s filT/£© b ft VMittfcjB*. ?>®A^* s: ?s«-r 4«Rff 
1H4t© (f i& iz % 5 fflj^CD{SB * A***** f 4 j&©&g 

i:btffi^-r4. 

[0016] mL<mwm.%uommz-o^x, xm 

^»aft©jS©(ft«C»J*;1-4*i»ffi«fc*4xv 

h;uigO-*ffibfcffig©as«lt:»*f*ttT, ^l^x 

^(»i:^ai-4c 
[0 0 17] Mttfflffftt.. #M*t^Hii§i: bT, ft 

so ^S^S^xy^ttai^i^-^fc^U #^©x 
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T&tK ifJ?*a^l/-*tt, P&fBt#&£b£<< 

C?tl<2>o 

[00183 #ssiui©A«ftfcH§SBHu s&c* ais& 
aBBc*b»e>n*BaitSBfcB-3v^ bbsjit 

*BBft t^ffi-T 5 A** WW * ABtHRBBfcfc 
f5„ A«3fr»gBfct> A»©*&M+©ttll&«*1" 
Sfci&fcifc>gfc<rt5*— *©B, $fe(±H^i;Af!l©^ 
fBtsmkftE©b;fc;i/y£7y:/^-:7;i/ftEBU B 

9TBB<t>©*BBfcBWBBfc©#J&*i:-a"Cs »** 

jfoft^&Etrr^ BB*ttBtt£BBB^ A^&m 

¥ IS cd Hi * f £ AB A 5 f S ^ ft E ft + CD ABlift © 
B©ttBi:#fc U lift • BBttBBBBB 4 2 ©BB 

*t)iic> A%©£M*©&Bft}i5£-faA«4BBtH 

ffli:, ABIMBfflBTfBffiSft&AWttBCB^ 

r> «ii>B«rt-c©AR*trBu A4WH**»a-r* 

ABBBttBBi:**-*"*. 

[0 0 19] BBa^+'y^lz-S/gS/OlofcLTx 
5o®Bf&®gHBBCBBlsfctt£ttB&% 
BftbTf#e>ft?>ft£i:©, H« s PB±<offiBi:©W« 
ft, *^5(ttB©^n— ^HflBfcAy^oftlMtB-r 

/ 5 &g© ^ D —7 WBW £ A * 5 ©S» ft H"f 2 o CD 

nm. ft bbt a c 1 1 <fc -a t fr t>n s . 

[0 0 20] *fS«CDAife^HdSBtt, ABtHRSBC 
i&tlRSft&ABBKft* Eft*«Bl/fcB*Ji:Ha 
f*B\ BKK»T*trRB*EBBBfc#-rS£fca«T! 

[0 0 2 1] #BB©AB»mBBB\ A»tHBdBEBS: 
J; bB&nfctHRB**- *fetitrRB*BBStBfc»« 
*fifcB*©B*lolHMfi**, jfiJBCJtebrlnxbB 
^ftff-5tr»BBB*BB ft^TU frfHB&BtfBB 
tt, BBbfcf'-^fcB^-C* B<ftl$M*fc!>©BB 

bb&^bbbihi c t> fc o -cbb* *»HBfti3B» 

t, lr«|gBKflKBEBCB«*n&BffiBB»& t) ©# 
BBRfc»IWB«MBB»Cia«3ftfclim**** 
fcfc, BfB©*frCBoTBB*. "Tfcfc-fcBBgR/ 
*j£B»ft«ffl-r4»KBB*» £ ftWTS c # 
5, *ftB®tHW£B^B®fli0&ltiB&2: bt> 
gtRBBBOTBRtiu ftBBKiBB btv^ SftjgflRft 
E«*-*«»BRBB»i:, tHWSBIBB^BCBB* 
nfcBttBBfcfc t) ©*BBRfcB»BRKfi»fcEB 
*nfc«BBftt«^^T, HfB©*frfc«orBBB 
lA»fc»)©B«Bc, tfcfct^ 3fcJSBft/«eiB** 

Bttu B^-rs. 3pJ9BB»B^ffl**-r4i 



(6) 

/0 

[0 0 2 2] *£B©trR££&**&B©ft©£ft£B 
fcbt, frRBBB^SBtt* *B«fctt«*ft-C^* 
i/5>RfcBB"*"*BBl'5 ? RKB»i:* U3>fcB*BB 
AR*> £8t££ft5ftj&i' S>» kBB u fftBBBBfc 
BBSft&i/5Hfcfc*tt*U SBBBCBBSftTV* 

s*>ftjf^©ife^tt£ot:BH-b*^5b^B3>-y- 

;i/ h SB t ft 5 - b. &X # a . 
io [0 0 2 3] *BB©ft«BBB^B©ft©BBB» 
fcbt, Sr'BBBBwBBtt, #BBfc±R©B»fcE 
Bi*ftT^*B»B»*KBt"aB»rt«BBIBfiB 

#£B»rt©BBAftfre>«B£n*BBBBSR 
fc^JMREB*B£KB3ftfc«»flRfcfci^U ■ 

UB»f *B»rt«BB*3 c k 

[0 0 2 4] *BB©8HWS*B*8EB©Bt:BfflBB 

h 7 * f a >«»#BlftBM*fc t» KB < ARftfBBT 
SBffiBBBBAREBBfc U 7 b 5 V>{iT h 7 ^ 

AREBBCEtt * tifc& 'J7hSfeli7h7^>>3> 
Mf&lfi&WlfM&tz D tB < ARiP »BBBfc*v> 
TBBtf^BBB!©*- K^fc»-f5B*BB- (^T- 
^ SBB© AB/#(ftBBCBR*«ffl < AR) ftBtU 
b, BBB»rt^©&BjSlca9!W-&»SMR*:i:tBttlb 
feft-feBHfcaavraBfcBMBjaSSfcftfc-r*::*:** 

[0 0 2 5] 

[ffffl] BBBBaSHs* b*«Bf *«BBBWB 

tt, **i^n^BSMftft^fiEi-5ftn^ §^©#^ 
»^ajnfi> *n6wa«BHJB©B»iiB«tfrnfe 

mwuam »m * ©Hftia k# m*nft ft s 
*n-tn©w«BBa»c»B-r*BBB*«fa* 

BHJSCffl^fBfflfciB^riqlt^ffBBb-CSta* (-&J5£ 
fS) i:, &BftH©1^SBft©lR]-B#ttm*5. 1 
40 LA^b> §HftB©B*S^BfiIIft*fcttRI-^Ba 
®ft©S'&agP^ (WT> SftSWBBBBS^-kia 

f) a, ±E©TO£a ••^^sftb-ct, *ne>© 

^fiiHftgiS^A 5 , ¥fr^tt • £«BBC £oTfifcS 
«t a J&ftgiJj&BWttBfcft^tiBBft* ^ tittji^ 0 B 
B-rnK, ^S*BtliB©ffl*fiBBi:^l-©fflMiBBft 
tioWBBBfcB^h fftto-fex ABJBtt^x^fc'&B 
rs#B»lift©*A s ¥fT^» • -^fiKJlSK: ioTBB 
HB*c5o *BBtt^ coBlCi-at, ^aS»lift® 

Atnift©#^ftiBft©^ftJaaii-5 0 

so [0 0 2 6] ^©BKiBV^aABBtt^^Utt, 
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±##©ltt^yytfl8&7c£b-C, !i&*©A$!©¥ 
(4, ^©/h*l>H8IKtt/J*iUDlffll*ffi3^x * ^tfctH 

^©A«S«*fctftW1-* 
[0 0 2 7] w±©*a*fflc^t»aft(T"5ci:fc«fc 

^«Riffl«©»i^fefl : t»-r4«w* 5, j>*''^»N ee#© 

[0 0 2 8] 

THiii*#!HU-C#lltBi9i"r5.- @ ltt#«Hli©AW 

ft:^fi£l2t-ifeSo *»«i©A4Mftlii8Bfck 

5 1 £HBftft£B2 hA4MftttiSES3 fcAflitHK 
mm 4 £&HK&XBBtt£EB 5 £grft«£&j&EB 6 i * 

[0029] ♦»©Aiw , *aE"r«*Hka! 
—•a «£KiciK t)#x.tm^©NfParapsT-^ t> & 

iBBSftS. . 
[0 0 30] A«fcffi$5EB3 i4, AftOlftMJ&tt^fl' 

*«#u ffliM)ii»«ii2t«tr?riR>)a*nfeiii«*» 
awfesnrv^AttkbT^ *ittA*i##&"raiR«fe 

[0 0 3 1] A«trft£B4tt> A»t*W«B 3 C ,fc t> 
T»6*ifcA4WWBii**»6> H&*©#i#i*ifc#£-r 
4A1MM&&HR**. tr«*&iM3«SB5«U A4MHK 

kM««-»r**B»-r«. tHWi*awit«6tt, a 
tii+^B4T-n-is$nfcia^< : f©A^iins^ sfc 
affiEftflcissfBttiSB 5 £**3n&i£©n»*gE$ 
»«A*tt*WS**. *Kfc*triinxb"r«w*ff 

do 

[0 0 3 2] *t**!BeS8©»f^*Ki«-r4. 0 2 
J4, *«S»JBfc*B"**WI^--^->*a%'r7ri— ?-ir 

S#f&©A$J8f£^ir«§!7i'-A(4, «§Pfcf#igB2 



(7) 

314, HffertCB*n*#A«*ttHi"r*«!fli*ffa 

Ur^A2) . *xv:/A2©WCA4M*ttiSSB 

8B4KJ;-3T9f«*n4U5 i ?'^ , A3) . tHft£& 
14, HBfc«*3ftT^S«£A«Ri:bT\ StftlSX 

io [0 0 3 3]'A«llHRilB4CJ;t)riHfc*nfcA1WH- 
*3«tt5H-|S)g«I3tt8B5{Cg«$nfc3i*© 
RMftfeffSAAMttftllJIltiU tHWiJllB»»Befc* 
v>t, jfeBcjstr, gfcft, aM£*©B#fc*&TV 
mz-imm^tt-r ^m^m^^y, zitwrnw*.^ 

©B*£jjs&^ «*fciQX#fT*)ftfc*\ Sl^£ft3 
Urif^A5, A6) o 

[0 0 3 4] fil±©ffiBjWlftT Ltz'&, £ 5> t A^®0 

«lIBt#UTlRWIC»lftH!)"j8b (MA7ffl 
io Y) , lB»JUj#*VMi*Cttfflaftl*7*-* (*M*A- 
7©N) o 

[0035] e i ©Attttwas 3 (D-mmftm* 
mmr^o sm4, a««hmb3©-jws«©«mi*^ 

■T^nv^HB***. #ISSK09©A«tfftHi*EBtt> 1MI 
3 0 1 ^ffHBHfiBffffi.3. 0 2 3 
0 3 ^fl^T^So 

[0036] ftrnmnttiffl 3 o ui, nmin mm 2 iz 

±^"C#6iifcBMI4>©*jSlfc-3V^"C» m^lS (Atttt 
Bi©fcafci&fi&«*B*) ©BBWf|»©lllia*ffV\ 

30 *n*n©iiB«faBftBiB't'©aaai:J*is** - tHi* 

[0 0 3 7] firftBHtUS 3 0 1 (4, Attlttff ftlEtC b 

A^tt ; e^u±©^©iS!^^tifciSiS©^t ; e-n^n 

BJaTEBSnfcHioWiUMteHS***^^*. CI 
T, '©.1 i£I©13m*tfcW^£^m»&ffii§-fe » b fcK ' 
To Ltzftr>X, AftJBtt^^ftlHB^ U- ^A©fe2> 
tttCKCktt, «IWi«Hi»-fe» ht^ttdtBKiB 
<Chfc|5l^T-fe5o ^ili©IUIi0!lT?U4W-rs«kat:, 
» A$ffi&©Hi?£ffe©HB©l&ffl*\£>&8 | J'f 

14, mHHfttUSHsyhi^ AftJKtt^^^cHW©* 
ISffiBtEB^tifc, llf|(«tt)N1-«WflkBttU« (« 

A1fc©BIB*fli©BB*&«Wf*»&fctt, ^WSil 

»j"raa»©««Bttffi»©flbt, xm^^i^m 
fflcffijeffiBcsfifciftaratfBBttajBtfEBsSft 

^tBi§«4, «abJ:di:f*A*©W«fcl6tT»*« 

» «a©»«a*ffl»*«sft*ffificBte*n4. 
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[0038] z<D\mwe7)\' (i¥u<tt, xmm 
m&m&-7\s- a©, x%*m&L&ok.'?z>m®.m$ t 

±cfctt5^ft^ft©^{itc#jrr3$tt{jm£:fc^T 
A^«&fc«fctf*©te©#siffi&ft®M&&tfi-f a. 
§fifi{as»gi5 3 o 2(±, i^mfi^as-bf h©&#&* 
tftW8S* s > ^ft^ft©*Bftfim&&*>&#e>tfcttibfc i 

®.<D®»m&. (WT> hfcfiBf) ©fit 

gP3 0 2{±^ Ifflffe7I/— A©**WC»liS , rsiTffitf* 

att¥«fifitiiHfc&£/rr5. 

[0 0 3 9] at^JaS*SP3 0 3tt, f¥fiSjfifi8Sf?SIS3 0 

2t«ko-c*m^nfcfFfiffiffiiim^b> ®&yv-& 

[0 04 0] A$»^tt^7^l'* s A1MH££MlE£-£&b 

tts ffl*©SI»ti* s &£. loclllShLt, A 

So £©»&K:Bu «fa*ttffiS-b-s»bo#«fa»tftffi 
HAS rsffH«pKj tfcttibfc^&S-b s> b©fit©-r^T 

<fecauEfc^ab"ci>*fc ! i ! !ij£*n4. --t*> rgjs 

b&BtH^iF , 3■r•lRI^ti:v^5itI*•r•feSo ^irr 
*£JS«T?JB^&nT^**8t©«fc5t^ trauiftHMB 

[0 04 1] JfcC A4to&tttM£t (02©^r>y7A 
2) &B|4(Z)7D— f-v-h*#BRb-rRWfS« Si?) 

fc^-t©fS$«A J f?ttl£ftS Urv^B 1) . *t 

»e>nfcWfR«n«t»b, ffflfBniWiJ3 0 2c*^ 

T, E^7b-A±©#{5iStA» ) R ; &^l'^a§v 
^©AtHKtt^^-ho^i&ttJebfclKftGJjSt:*^^ 

• fffflittftJWbU #8&Si¥<MI£, S»fflKlc»(S1-S 



[0 0 4 2] ft&ft&fMSttIBft& fiBA^fi?mgB3 0 

6ftfc»J^8©*iC»©flBIBB\ A^©#£-f s^hb 

ii [0043]BI5tt, H3 © A4MftmStt4>HitIkM® 
**»««© A*Wftffi««tt^ 
#gf$ 3 1 fcfMMnift&titS 3 2 WB:toa«*» 3 3 £ 
fflt*.T^a. ^Hffl5^©A%tftHl^®tt> E3©A03t* 
BJgp©4fStttfctB§§i: bt, o:»s><ftaW-^v-**« 
l\ WRiStUS-by htts A«»B« : e5 s ;i'©lt»±©- 

^©»s*nfe«»©jsic-en*na«dnfc 1 m©x . 
i3i> imuMtertss 2, o^jmmiss 3(± v 

*ft*nH3©WWMHMJ3 0 1, ffffittSIIVffiS 0 
»• 2, ®A^^gB3 0 3©SUIB«tfft*. 

[0 0 4 4] M^Sa^gP 3 1 AfcflKtt^Jl/ClMP 

±©Hfjfett«fc#i6"r»#i»tt«*«t».tiii**n-cv^ 

S l<fl©3iyS?ttHi*^V-^*fltitT^5 (WT©I2 

{aaKiBEB^nao ^n^n©x«>^ai^L/-^ 
m?mmm& 2 c * »> n e> n& awbims «t v» 

So 

[0045] a-ii/-*** hftwja-rsx^yttiu* 

©xyi;tft|Ji^V— 'Rl— B*©«^'Iffl**H * 

n6xy^tftHi*^u-^©ffl*fitta«it"rnfctt«fc 
gij^©iH®t^ii^*^s!o-rs^t(±, ^en^n© 

x y ^Hi^l/-^ t*fj6S1-5Bi@*x >y VftLfo*'*. 

fc> &II®©^Ii^©l§l— gB^(4E*tSo b* J 
b, *Bli|©Sft4«^BHftSfcttra-*fl , liflfe©S* 
(WT, Ssfe-Sxy^gp^-iilB-r) i±> ±f3©¥ 
ff»» • ^fiE^aSTbtt), ^ne>©x>ys;aj^As, ¥ 

n&m - -SfSMMiz <fc tj x ma s <k a &$?sy&*§*MAa 

t^tmti, S^S^ttt^v^o »Sfii«s x»s?tt 
so W;fr^b-*©ffl#ISai:l5!-©ffltt@2B££ojLy^ 
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IS 

[0 0 4 6] S¥«Bffli&-S/j£g(53 2tt, h5I3D1»!»^SI5 

feft^HftcDxyyfla (£tMf$t«) ©*«*©*»£ 
0 3 3 tt, fffiMM^JAfll 3 2CJ;otie. nfeifffi 

m®ftx-mmi&&Si*t-&z>m*&it%fimu *©? 
<c> c & s mss ©&b & a*j ##&-r a ^©{£ta t b t ta 

[0 0 4 7] El 6 teu *m&mX-&mt<tlZx- <f 5>ttttJ 

1-1 5 2 3 8 lK:M^^nTtM)X^^fcH^^b- 

^l/-^fcJt^Lt> ^U-#*ife©fi#&*#fcfc 
V^IBI«1IW«©M*lfiabfe*fflT?»o-T, #^b-#© 

©m#&f#fc^F^^©ig£ffi^b£3ft{±^ 

* tf&tBf- 5x>; S>©(ft«;fe <fc IF^IQ KfP&*I 

«k * ffl^© sefli l * i * «fc -5 1 -r 5 fe & r- & s . 

[0 0 4 8] ^©J^&xy^tiJ^l'-^tfx;? 
[Sis y#|o]©^*vetU'^T, *>J*2«1*t3, ^ft4 
ffitfffliS^ftTl^o ZLtie>©^V-^tts EI7£# 
Mb-t&j££ft3<fcd£, DB^©»?P©J^K{cjSbr^ 

h£> EH©H^mf#^B1^4^T 
^#?>nfe[B^±^©^{i[*t:JSfflt-sc:i:t cfcot, # 

as» t *«■ « & unfit -r * ®^n^ im n 

So 

[0 0 4 9] H 7 tt, . ^^©AWt^T^t/fcx y 
^tfttB^-^U— #©EE£^"f Ettf&So EI7K^£tl 

^Srt^t±i-r5'hM©2j-^^-^A j i2E$n, Bis&fc&c 



©;fr^l/-*#E@£tlSo E]7©<fc-5tiSg£ftfc5 

ii©*"* ci©ffl*f(as*ifi^bT^u-^ 

-fey hilUtiJ^So 

[0 0 5 0] *2gttffl£«tf3A«&ttM^£ft 

o-rDioa^nfeii^ sriafcaMMssi (E!5# 

to ^©xy^tfcHW-^l'-^K ioT^^ltSASfTfcn 

■aTf&aSftfcflJtfMifc (E!7©£ffi0!lT?tt5tt©«# 
Mm) Mifl[fflMfe^fiJ3 2C*V>Ts DD&rtlC* 

it a a* ©fl^K* <k i> - a $ $ t js& 1 1 ^ toia^ $ n-t i > 

0 7 fc*£ftT^3<fc5&A»R ; &7 ? ;i/C*iEo-t 
[0 0 5 1] JM*#J£fcfc, $L?®i7 tpizmznx^zA 

■r 5 /hs©*^ i/ — * t <t t> t» e> nfc#^iBftft#* 

x y y <fe^tH-r 5 'hS©3T^ V — * t «t D » n&*^ 
^etvx ^ [%©x >y V fctfctB-T S AM©^ U C «k t) 

[0052] ifet, ±K©^^;n*i©#^e)S*^o 

S#^BD»*¥ff^i&f S (^t>^C2) o EI 7© 
*WM-ettffllRfflAfc:**J4i-r3 y^lSjc^^Ji-^V-^ 

[0053] ^e.c w»»b&#«»iMfefta*i* 
-rs@j^©ii^iji (^t&#^M) ©afcutau ^©* 

(Xri'7'C3) o 

[0 0 5 4] £©<k5KbTi¥§fifSB&£J?K8B3 2C«fc 

9t»6 nfcMHfin&tt, s A^rna? 3 3 1 * v ^ 
(fi&ciijRoaswtfs Ati©#s-rs^iibi:tti*^ti 

[ 0 0 5 5 ] El 9 (i^ m 1 ©A»ttRSE«4 fcfflflGB* 

tmmm. 5 tn-^^a^s 6 ©nsfs^j^siwr s 

feCllfcglEIT-feSo 

[0 0 5 6] *Hfi(Sfi?!lT-tt, 5©ffig*5 J;^ 
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1^ *fctt«»ffl»S£r*. ^bt, Ell 
© AtJtfctHISa 3 T-f#£ftfcA^©sii©{£H* s &il$J$I 

[0 0 5 7] JHUIiiU-tfct, A4MHR8B4T, MIBA 

iH^cDftat)U= {ui, vi I il±0jb>£8SA&- 1* 
f©B»} #s &A4MB«KR*Vj= { (u, v) | t 
bj^u^t t j, t 1 j^v^t rj} (j(iOfre>Ai#J 
8$l«|i2&SfcR^l£'t*©&gU tbj, ttj, tlj, 
trjfcfc, ^-ft^^ j#B©^©T#ft> ±^IrI> 
t*IqI*itFS*l%©ffiWI8Mi[) flCXoW8*flS 

5„ A«8H&SB4BU S3l3A*»tH*«3C«fcoT» 

[0058] m^mmmm 5 b, ABtHRSB 4 c 

«fc»)tHR*n&A«flRft, B*3ft;WMW«WfcBmMi 
»BbfcBai4:Hjitt-W\ «*BE»1"«. 8HWS*«^ 

KB*, * fetttHRte*E«S« 5 CBBSft&B*© 
ff'tt fcfe It 5 AfDWRBBfc > * nti&ffi&m £ & 

urns bt am o 
[0 0 5 9] *WWIl:J:t)T, 

liffi!P?©^AR*M*JfflbTl>S*§!J£S&£o 

R*»feBK*-4Afc£©tl«#*rB4:&tK 
[0 0 6 0] @10li, 01 ©Af0ftRS§B4©-|lJ& 

1 #b) A^ffiB^ffige 41, bb • VLMMtaiM 

354 2, A»B*tlilB4 3.fc«*.T^*. • &H 

^AiBtts 4 2 AWLW&mm& 4 1 -e a«kd$£ 

V M£B& i: ABoffifflffiB * BBtt b fe ;u * £ 7 » ?x — 
:7;i/*HBB*nfct>©tK B^*fr-5li9t*Bt«IJIB» 
£t**'J7V— S"3> (BIE) ^froTa**©*® 

[0 0 6 1] A«BtfctBgl5 4 1 Hi, AU^H^S 3 
(BIBB) ©ffi^fc^©* *fflB*©B©(ftBi:#fc 
U B*-tftfiMi6ia««B4 2©B**t>fcfc, A* 
©S^*©{4S4«^-rSo A4MfKttBffi4 3«\ A 

BffiBt*WB4 iTf«m*n&A«i(ftBftt»i:t^ 
Bawe©A»*w-»r*. ihmssebbbs cbi 

#B) tt, Att«Kft«ffl4 3fcJ:Dttffl3ftfcA»« 
BBftBRbfcftttfcNBttl*, jS#IB@f So 
tHKBBBqVKB6 '(Bl#B) fct> A4WHRBB4-C 



CBB*nfcii*©^JC*tt*A<»B*ftjfcBKJ®t 
[0 0 6 2] WT> ®& • ttBW&BBV 4 2 #fT-5 * 

*>*»&©#©•£*<. ^©rtffl^^7^-^»to»«ctt« 

10 afc^«fc©ttTsai©^8sfc«fcKiia 
(#f:Roger Y. Tsai, "A 
n Efficient and Accurate 
Camera Calibration Techni 
que for3D Machine Visio 
n", Proceedings of IEEE Co 
nference on Computer Visi 
on andPattern Recognitio 
n, Miami Beach, FL, 198 
6)0 

» [0 0 6 3] Cft&rt*>t5*-*;M89re** 
Z.£%ffiM£LT. UT©£3££Mit<©:*>J<9ttB$ 
■■ J:l«6B*Jt3fe'i-4U!tT, £»*©*.* 5ffiB*s«fctf 
BB©C^^Bvt?^— ^fcif^tcm. El 
ltA^7i2S> ABttBftBJefSffllBc^^B* 
01 l©€TC»*Bj*lOtt^D-^;HsW*o 
Hj&T'&tK BB±fll ICiaCxy z|fi£?£«)5 0 
El 10#^(xj, yi, t) («BU i=l. . . 5) 

©5fe#t»J:5if-|IB!»*A©B© , t , 'Ot*fe*B* (* 
30 aipe> 1 4 0~1 6 0 cmJIJg) (C&£ <fc-5£:S;*£& 

64>t©ftor*<. (SdCffiB*©«*MftR©»*»o 

t o & 5 jjsi-en b* o ctts-ra c i: % wteT-«* 5 

^ BflE*±lf*«ja*e»»6*»U»ii©J:5*5ia* 

sje-r*) *fc> A*ttBftjfe£"r*BH4:brtt, b 

1 l©4j*(xi, yi, t) ({fiU i = l. . • 4)f 

i£BS©(xo, yo, zo)£&*fc©fcU ^ffttt> z 
W©iE^(Sit^bTyfSlsl»3^^aafdJt*i§s 

4« feLfc^S(4g (SB) fc*54»©fcr*. (u c ,v e J 

D % (ui, vi) (i=l. . . 5) tt> (xi, 
yi, t) (i=l. . 5) #m&$iixyk-?fcwm<D 
mm (HBB±©«ja©BW) T'^So 

[0 0 6 4] Z<D£%, m&m±<D& (Ui, Vi) (i 

= 1. . 5) <D#v-jwmm (Xi, Yi, Zi) aw 

T©J;-5t^SS. 

[0 0 6 5] 
[Rl] 
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u\ = d k ■ {l + k((u, -f/ e ) x + ((v, - v c Y )}• <«,-«,) (1 1) 
v\. =d k ■ {l + /r((». -« e ) J + (<*, -vj 3 )} (v, - v c ) (1.2) 



[0 0 6 6] K<k^Tf#e>ftS> u 
[0 0 6 7] 



* [ft 2] 







fx > 








Yo 


+ 











'cosp -sinp 0Y cosa 



sinP 
0 



cos(B 
0 



A" 



0 

-sin a 



0 
1 

0 



sin a 
0 

cosa 





fx > 






Yo 


+ 









'cosacosp -sinp sinacosp 1 ^ 
cosa sin P cosP sinasinP 
-sinp 0 



cosa 



(2) 



[0 0 7 0] 
[ft3] 

x-Xj = y-y { _ z-t 
x 0 -Xj y 0 -yi Zo _t 



[0 0 6 8] *sfig?3fco 0 ^CT', *tt£ftJR£ftft-e 
ui' =ds (ui-u c ) -j&ftfcA^ 

©*§£,, 36ffljR3i##iE-r*©Tfx aaftii*^** 
! £>-rbfe^t)iz:fc^v'«o si (i. i){i-?n$:ffiiE-r5fc» 

©ST'foS) o 

r0 0 6 9!S (2) *6»e.n* (Xi, Yi, Zi) * 

(Xj - XjXzo - 1) - (Zi - t)(x 0 - x,) = 0 (4. 1) 

(Y, - yjXzo - 1) - (Zi - t)(y 0 - yi ) = 0 (4.2) 



•(3) 
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[0 0 7 1] ±Cfe5, fct, ^SASfig^i:^. 
[007 2] - 
[ft4] 



[0 0 7 3] S (2) (Xi, Yi, Zi) & 

[0 0 7 4] 
[ft5] 

^ = / t (*o.J'».*o. B, j 0) 
= /* (*o . >"o . 2 0 > U 't • V 'i > a 0) 

[0 0 7 5] (DX-oVz, x(^ yo^ zo> a > *>* 

(Ui' , vi' ) (i = l, 2 • • 5) T?Sl£ftS© 
X\ A (2) fcS (4. 1) (4. 2) fcttA 

•rSi:> A (4. 1) , Si (4. 2) fcfc, (x(^ yfls 
as /?) ££7>* (uj' vi' ) > (xi, yi, 

t) (i = i, 2 • • 5) -t-asns. ^©at., (x 
i, yi, t) (i = i, 2 • • 5) « % ^»BSte*nr- 

vi' ) (i = l, 2 • • 5) tt, (xi, yi, 

t) (i=i, 2 • • 5) fcfttt*ftHT*ttilftl-* 

©i©fit£*fbT (xos yon ZO^ «> 0) fco^T 
©5at)0^igS (4. 1),. *SS(4. 2) £f# 
S„ c:©5o©;fr|iS>?>> I'h2iatiot5oo 
/t7^- *x(^ yos zo^ <^ 0©ftt>ft*»S> bVMI 



£f#S;:i:#T-i*?>o 

[0 0 7 6] ft/J*2H8tCkoT, *^7©{4® 
(xo, yo. zo) *«fcV»ft («s /S) ©St.8i^?> 

30 LiMiftftjrrafca&c, s (4. d ©£>a©2fg£: 
A (4. 2) ©£2©2fg©fn*i:?K ^n&s 
(ui' , vi' ) fc-f&o 5ffl©;t7*— *xo, yo, 
zo, a,/?©ftfcfit*>e>U^<fitt> S^ffll>fei'>2§ 

tfti^tiCCMarquart^ife^ Will 
iam HoPress et al. f« WIS? 

ft r=.j--t vti)\,uisv • mmmmtt 

©.5 0 5-5 1 0H^Pb<^A s ^*iTV^ 
So ^«ft«/^2JHiS©rtSB:*m»i:Haitt©ftv^cD 

0, yo, z o, a, 0\mm. • <ftft*fl6E«8ft4 2 Cft 

[0 0 7 7] mz, Atl{4S^ttiSS4 1 ©nation 

(DmatpfoiiBtonzmm (u, v) tftfetH^nt^-r 

So ^©fc§> £©Hjil©^a-;<;!/®g^T-©ffifHI 
(x p , y p , z p ) {±S (1. 1) , A (1. 2) fcpi 

«©«J&**JC:*-3&eiT(0 (u' , v' ) t*fU a 
(5) ©<fc?£S£ftSo 
s» [00 7 8] 
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[»6] 



[0 0 7 9] 

















V 1 : 




■t 


+ #r((u 


-o 1 










'cosp 


-sinp 










sin|l 


cosP 


I z pJ 








, o 


0 



5* 

J 



* [ft7] 
cosa 0 
0 I 
- sin a 0 



sin a 
0 



v U '\ 



\ z oJ 



cosa J^- f > 

'cosacosp -sinP sinacospY u'^ 
cosasinp cosP sinasinP I 
- sin p 0 



cosa 



[0 0 8 0] Z<DA®<D%m*t1:&2>tfr-&Ltz£ 
A«MO^B-^yi*ll (x, y, t).t±S(3) 

[0 0 8 1] 
[ft 8] 



.(6) 



[ 0 0 8 2 J £ft J: !K AWC^D-^Mgli, 

[0 0 8 3] 

[ft9] 



x = 



y = 



t-z n 



Z P~ Z o 



(7) 



t) a&flltfftAttft 



[0 0 8 4] i:LT*fef>ixSc 
uCi^tbtW; (x, y, 
«ffl-»*4 3{Cffi*-T5c 

[0 0 8 5] *fc, AWfcWfcWSM 1 <D9m*Mffl\j 
■TifeftC, Iit£*©:£ilf5i£-^T (1. 3) 4»e» 

(7) s-eoswfcWKrfcfT^'c* nft • (ftB^Aiatt 
«wfta8*3T?#»e>nfc- (u, v) tMit^^T 

(x, y, t) *#®ZJ5& ! b&Z><, 
[0 0 8 6] A«B*ittHI8ffl4 3©fflfl!fcoV>-C 

nfif«. HI 2tt» AftffifitfcaSU l^oTff*. 

i;bT> Ell 1©4£ (xi, yj, t) «SU i = 
1. . 4)-CH*nfc1W«**«WB!*bTV^*©T, 0 



V (5) 

A-fJ 

TjsbbTi^A^ «W©«R:fe 3 ttJB 

mst*- 4 i i: 4»tj * * • Bi3t ttft««* «ai-r * fc 

{(x, y) |xi[i]^x^x r [i], yb [i] 
^y^ytti]} (ittl. . 3 6*^©It) 

xi [i] *5«tlFx r [i] fcfc, ^fl^e 

n««i©fe* (£3) # ©xaa«Tf 

«ai©T«l (Tic) **W±«I (±J&) ©yMsirefc 
5. §AWS©yn-^MSMT*(DiS: (xj, 
so yj) (j ttl*6A«ftft*tO«l ktnii, (xj, 
yj) eSi©£:t (xj, yj) jbWii 1*3 
•TSo £©J;5*#i£T!#««fc"^T*©#fc#4'r 
5 A^Oft ^Ul? U €©*§m£?hft*S*taiftg® 5 

[0 0 8 7] A«lH«St«4K:J:»)tt»*nfeA«H»ft 
gjfc *AlFtWWgJRffi«S«*5K:««*nfcil*©«F 
*Jfc:|3tt* A*JtHR*S*Bu tHMS*£*S« 6 fc*v^ 
t\ efi«**v^ttiiff#©s*c*6i:r0iAttiai 4© 
<fc 3 35:^a©A'J^IB^©ji^t-^ lfe^7 7t^L/fc 
40 t) (01 4t-tt> ^fc^lTC-Sl^bTl^j!^ ggHt£ 
{i*v-T'S^1-5) , «-/Jx«*©«FB»J©*ftO*<b 

#^l5£Wi> HI 4©«td«tJ£«*jlK*ttftA*iafft© 

mtt^y h*-^©tuttta©«^5&^t* 

[0 0 8 8]og(c, HI ©9HRI6*a*«a 6 ©-H 
JMWftBMBfa. HI 5BU W»«««S**EK6©»1 
©^JB09©^ny^Ht-$>4o fcStJfiWCttN /£gf©S 

so (Hl#{*S)'A>£ii&£iBtf#U tHRI3$SBtt£B 5 
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So 

[0 0 8 9] Bmg&iemSS6 0 2fcfc, POSfcifKE 

0 H4, 01 ©trtttSBBBBB 5 JcEttStifc^ftBS 
|ffl*fel»©*je«R4:«lE»JI««ia«ffl6 0 2£Btt 
$ftfcIgHgR£&i:fc, B#MBiJa*l>ttlSBSd££© 
HrBoftttfcftoTlIB* (SllfgR/3fcj£gR) 

n-rs. » 

[0 0 9 0] Ell 6J4, StR*SJIt*7j^B6©tfS2©^ 

2 (iai#iB) *»e>HB*B»u shrisbebbbs. 

{4, £ttfc*£ LfcB§^*HBR»li*Mi:#fcE«1- 
5. 

[0091] bbbbbbb 6 1 2 «:> • csmb l 

rv>S«»flRftIB«-r*. ¥«»WR*«»8 1 1 
t4, ii«&£BB£B5 (HIBH)' fcB«*ftfc*tt 

Rsra&fc & (D&m&mtftmmmmmw. 6 1 2 cbb »• 

Sftfctf£*HRSt> fcfc, BBWJSfcttBBMfcfcCBr 

tJfc«-u aavrs. 

[0 0 9 23 HI 7I±, tr«»*^«e«6©JB3©S 
ft*nBri£ffliR8rtfflA»Sfl*U BHRitfjRetMiB 

5fc*wt, *ft*n©tt*c*w-5AtttHRBBfc% 

l/SJfcB^KS&OARfcbTBBBtfWSftlfc&CEBl - « 
* • «« 1/ S>«BB» 6 2 2 14, EBB $ Vx 

41/SHRfcBB"*"*. 1/5>R3 bffl 6 2 li4, ft 

BU5>ttBB»BfcBBSftTV^l/$>Ri:felfc«U 
ftRtt&E * tit V > 5 1/ STOftMHK & -tH 0 ^ ^ 

[0 0 9 3] 01814, tHRBBB*«SB6©»4©£ 

m&{sxm&&%t.ntz>o A«w««fi4ttmj£©«« 

rt©A*9feiHRU gf-BftSSBttSB 5 & ^n^n© 

©AftfcUTBBMW*lfc#fc»#1"*. 
[0 0 94] 3gttF>3ft£ABBtt 6 3 2 {4, &B#SiJt± 

E©^»cEB*nTv^4caiattftE«-r4. 

ft*BR3 6 3 1 14, %«rttt£BBBft 6 

3 2 ©BBrt£«K*&»* *&B«irt©i«AR*& 

«**na«BiWB*fc«Jiii*Btt«BCBit*n « 



fcftJtflRi:&Jfc&b, SffBeCBBSnT^srail 
BtKS'Jfc 4 H {4B1B &J& WyjfBOBftCtto T BW b 

[0 0 9 5] 019tt, tWM&»«jj*BB6©B5©£ 
iS0H©:/oy*HT-&5. d©HJBKJBT?tt, 

* fc «4&Bjfefc zomsMWcft Lxn e>ns bb 

fcowt, *6*»t»Bfje©U7 hRDBBaSfettT 1 
h7^->3 >Ufei&©A & aMBfeXnUHMMfc btiS: 

[0 0 9 6] A^fhRBM4tt, ^ft^ftj9r£©$f?^l*) 
©A«*tr«1-*. ««B*EBBB5Bu *n*ftffl 
BBfcfcW-SABtHSMSB** 'J7bft^tt7h5* 
3/3 >JHKCB*H*©A»i: bTHBB»B*lfc#K: 
BB-fft. BttWiWWA»BB»6 4 2tt, »'J7h 
& £ v^4T h 7 * 3 yJUKtfBttttBfe & D t» < A 
R&BBfS. »*l»IB«w»8 4 1(4, BffittNMia 
AREBW 6 4 2 ©Btt U 7 h S ^ 
l4Tb^S-'3>S£i§:CM.ftJKg©, EBSiifcARfc 

JtMiwsBBiBAREBBfcEBSft&s-y y v ^tcht 

BBMfc*^TBB#BBiHtt©4f- £*fc*f-f £ft*> 
Bf IB (BA/*n %m%<D JJ^BttWBtlBft*»a < A 

so &i?fcHb, BBWRrt^#jfo&£S!B-fc»ji<«& 

^CBttbjfcfcfcBWtMtejVrft. 

[0 0 9 7] W±©^HJS©SBt^V>tt4, BBBff 
SSHbTSI5EnlHlt-$.t)> B*.(£*j<7©R> iff 
Ba*^i/-*©M#jett"*IB»©B, Afc^T^cS 
tt* 4 ^3liR-r 5 jjH©EB^flB«: ^fcWBttft V- 

[0 0 9 8] iSB©A«riftWBBtJ;*A«rtftHii!yi 
{4, H5*3ftT^&^ES#MfcCfiB£*iTV>4Atttft 

»*©«w©* fc-mff 

[0 0 9 9] *BW©A4WAm^D^5Att, ^R© 
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